PATENT ABSTRACTS OF JAPAN 
(11 publication number : 2000-177513 
(43)Date of publication of application : 27.06.2000 



(51)Int.CI. B60R 21/00 

B60R 1/00 

G08G 1/16 

H04N 7/18 



(21 Application number : 10-358141 (71 Applicant : TOYOTA AUTOM LOOM 
WORKS LTD 

(22)Date of filing : 1 6.1 2.1 998 (72)Inventor : HIGA KOJI 
KURITANI TAKASHI 



(54) BACKING VEHICLE UP ASSISTING DEVICE AND VEHICLE 
(57)Abstract: 

PROBLEM TO BE SOLVED: To assist the backward safety confirmation in the 
backing of a vehicle by finding an obstacle on a backward course for vehicle to tell a 
driver before he vehicle is moved back. 

SOLUTION: An image ECU 6 executes the backing assist processing. When it is 
detected that a shift lever is shifted to (P) or (N) by a shift position switch 8 in a state 
that the stop of car is recognized by a speed sensor 10, a reference image at the back 
of the vehicle is picked up by a camera 2. Then the reference image is updated every 
detection of the opening and closing of a door at a driver's sea side by a door switch 9. 
When the shift lever is shifted to (R), the comparison images are sucessively picked up 



by the camera 2 to be successively compared with the reference image by the image 
processing, whereby an obstacle at the back of the vehicle is detected. On this 
occasion, only an article within an estimated backward course determined on the 
basis of a steering angle of a steering wheel detected by a steering angle sensor 1 1 is 
regarded as the obstacle. When the obstacle is detected, a rectangle surrounding the 
obstacle is displayed on the image of an image plane of a monitor 3, and a voice 
warning is generated from a speaker 13. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The photography means for photoing the scene of a back field including the 
retreat course of a car, A criteria image acquisition means to be rich and to photo the 
image at the time of being in the condition which does not have an obstruction in the 
back field of a car and which be done as a criteria image with said photography means 



at the time of a car halt, A comparison image acquisition means to photo the image of 
the back field of a car serially as a comparison image with said photography means if a 
shift control unit is switched to a retreat location, When an obstruction is detected by 
an obstruction detection means by which a line detects an obstruction for the image 
processing which compares said criteria image and said comparison image serially, and 
said obstruction detection means, it is retreat exchange equipment in a car equipped 
with an information means to report that. 

[Claim 2] The stage to photo said criteria image is retreat exchange equipment in the 
car according to claim 1 which it is with the time of said shift control unit being 
operated in a parking location or a center valve position, and the time of the door of a 
driver's seat being opened and closed after that. 

[Claim 3] It is retreat exchange equipment in the car according to claim 1 or 2 which 
said obstruction detection means is equipped with an obstruction recognition means 
by which an obstruction distinguishes and recognizes quiescence body and migration 
body whereabouts, and said information means distinguishes quiescence body and 
migration body whereabouts based on the recognition result according the purport by 
which the obstruction was detected to said obstruction recognition means, and 
reports. 

[Claim 4] Said obstruction detection means is retreat exchange equipment in a car 
given in any 1 term of claim 1 equipped with an obstruction judging means to judge 
whether the real size of a detection body is judged taking into consideration the 
distance on the image data photoed by said photography means, and this detection 
body can serve as an obstruction - claim 3. 

[Claim 5] Said obstruction detection means is retreat exchange equipment in a car 
given in any 1 term of claim 1 which judges as an obstruction the detection body of 
said anticipation retreat course which was equipped with an anticipation course 
calculation means to search for the anticipation retreat course of the car in a 
photography image based on the signal of the piece angle of a steering wheel, and was 
searched for by this anticipation course calculation means within the limits - claim 4. 
[Claim 6] Said obstruction detection means is retreat exchange equipment in the car 
according to claim 5 which judges as an obstruction the migration body of this 
anticipation retreat course which exists out of range while judging as an obstruction 
the quiescence body and migration body which are within the limits of said anticipation 
retreat course searched for by said anticipation course calculation means. 
[Claim 7] Said information means is retreat exchange equipment in a car given in any 1 
term of claim 1 which is the image display means which carries out image display of 
the purport of the existence of an obstruction - claim 6. 

[Claim 8] Said image display means is retreat exchange equipment in a car given in 
any 1 term of claim 1 which is equipped with the image display device which displays 
the image photoed by said photography means by the animation, and is equipped with 



the superposition display means which indicates by superposition the predetermined 
display which shows the purport which is an obstruction to the obstruction on the 
image projected on the screen of this image display device - claim 7. 
[Claim 9] The car which equips any 1 term of claim 1 - claim 8 with the retreat 
exchange equipment of a publication. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention detects and reports by the image processing 
whether an obstruction exists in car back before car retreat, and relates to the 
retreat exchange equipment and the car in the car which supports the safety check of 
the back at the time of car retreat. 
[0002] 

[Description of the Prior Art] When retreating an automobile conventionally, the image 
of the car back photoed with the camera is projected on the screen of the monitor of 
a driver's seat, and the back monitor which looks at the image of the screen and 
performs a back safety check is known. 

[0003] Moreover, if an obstruction is approached during car retreat with the ultrasonic 
sensor attached in the car posterior part, the obstruction detection equipment which 
detects the obstruction and tells an operator about that with an information sound etc. 
is known. Since existence of an obstruction is reported to an operator when an 
obstruction is approached during car retreat, before hitting an obstruction, a car can 
be stopped and the collision with an obstruction can be prevented. 
[0004] 

[Problem(s) to be Solved by the Invention] However, it did not pass over the back 
monitor which projects the image of car back on the monitor of a driver's seat to only 
project a scene, but depended for the cognition of a back situation, and decision of a 
safety check on the operator who looked at the image on a screen. Therefore, when 
the operator overlooked the obstruction in the screen of a monitor, or when it turned 
round back, it looked aside and looked back upon an eye from the screen of a monitor 
and a dead angle was made in a direction and the opposite side in order that an 
operator may retreat a car, there was a possibility that an obstruction could not be 
discovered. 

[0005] Moreover, the obstruction detection equipment using an ultrasonic sensor 
detects that the car approached the obstruction during retreat of a car, its detection 
range of an ultrasonic sensor was quite narrow, and after it approached to some 



extent it was what detects an obstruction. Therefore, even if it could discover the 
obstruction during retreat of a car, it was not what can detect an obstruction to serve 
also as a back safety check during the stop before car retreat. 

[0006] Therefore, an obstruction was not able to be discovered unless it was after a 
car actually begins to move and approaches an obstruction, even if the obstruction 
existed on the retreat course. Therefore, when a sensor detected migration bodies 
which have invaded, for example on a retreat course, such as people and a ball, there 
was a problem that discovery of such an obstruction was overdue. 
[0007] It is made in order that this invention may solve the above-mentioned 
technical problem, and before the purpose retreats a car, it discovers the obstruction 
on the retreat course of a car, reports it to an operator, and is to offer the retreat 
exchange equipment and the car in the car which can support the back safety check 
at the time of car retreat. 
[0008] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose in 
invention according to claim 1 The photography means for photoing the scene of a 
back field including the retreat course of a car, A criteria image acquisition means to 
be rich and to photo the image at the time of being in the condition which does not 
have an obstruction in the back field of a car and which be done as a criteria image 
with said photography means at the time of a car halt, A comparison image acquisition 
means to photo the image of the back field of a car serially as a comparison image 
with said photography means if a shift control unit is switched to a retreat location, It 
has an obstruction detection means by which a line detects an obstruction for the 
image processing which compares said criteria image and said comparison image 
serially, and an information means to report that if an obstruction is detected by said 
obstruction detection means. 

[0009] In invention according to claim 2, the stage to photo said criteria image is in 
invention according to claim 1 with the time of said shift control unit being operated in 
a parking location or a center valve position, and the time of the door of a driver's seat 
being opened and closed after that. 

[0010] In invention according to claim 3, in invention according to claim 1 or 2, said 
obstruction detection means is equipped with an obstruction recognition means to 
by_which an obstruction distinguishes and recognizes quiescence body and migration 
body whereabouts, and said information means makes it the summary to distinguish 
and report quiescence body and migration body whereabouts based on the recognition 
result according the purport by which the obstruction was detected to said 
obstruction recognition means. 

[001 1] In invention according to claim 4, said obstruction detection means is equipped 
with an obstruction judging means to judge whether the real size of a detection body 
is judged taking into consideration the distance on the image data photoed by said 



photography means, and this detection body can serve as an obstruction, in invention 
given in any 1 term of claim 1 - claim 3. 

[0012] In invention according to claim 5, in invention given in any 1 term of claim 1 - 
claim 4, said obstruction detection means is equipped with an anticipation course 
calculation means search for the anticipation retreat course of the car in a 
photography image based on the signal of the piece angle of a steering wheel, and 
makes it the summary to judge as an obstruction the detection body of said 
anticipation retreat course searched for by this anticipation course calculation means 
within the limits. 

[0013] In invention according to claim 6, in invention according to claim 5, said 
obstruction detection means makes it the summary to judge as an obstruction the 
migration body of this anticipation retreat course which exists out of range while 
judging as an obstruction the quiescence body and migration body which are within 
the limits of said anticipation retreat course searched for by said anticipation course 
calculation means. 

[0014] In invention according to claim 7, said information means is an image display 
means which carries out image display of the purport of the existence of an 
obstruction in invention given in any 1 term of claim 1 - claim 6. 

[0015] In invention according to claim 8, in invention given in any 1 term of claim 1 - 
claim 7, said image display means is equipped with the image display device which 
displays the image photoed by said photography means by the animation, and is 
equipped with the superposition display means which indicates by superposition the 
predetermined display which shows the purport which is an obstruction to the 
obstruction on the image projected on the screen of this image display device. 
[0016] The car is equipped with retreat exchange equipment given in any 1 term of 
claim 1 - claim 8 in invention according to claim 9. 

(Operation) According to invention according to claim 1, at the time of a car halt, it is 
rich, and a criteria image acquisition means photos the image of the back field of a car 
as a criteria image with a photography means, when it is in the condition which does 
not have an obstruction in the back field of a car and which be done. A comparison 
image acquisition means will photo the image of the back field of a car serially as a 
comparison semi- image with a photography means, if a shift control unit is switched 
to a retreat location. A line detects an obstruction for the image processing with 
which an obstruction detection means compares a criteria image and a comparison 
image serially. An information means will report the purport in which an obstruction 
exists to an operator, if an obstruction is detected by the obstruction detection 
means. 

[0017] According to invention according to claim 2, when a shift control unit is 
operated in a parking location or a center valve position in addition to an operation of 
invention according to claim 1, and when the door of a driver's seat is opened and 



closed after that a criteria image is photoed by the photography means. It can be 
considered that Michigami (that is, car back) who has passed does not have an 
obstruction immediately after the car which has moved forward stops. Since it is 
actuation in which operating a shift control unit in a retreat location or a center valve 
position immediately after a stop is usually performed, it becomes possible by 
photoing a criteria image at the time of such actuation to acquire the image which can 
be regarded as there being no obstruction as a criteria image. Moreover, since it is 
usual to check car back once when an operator once gets off and takes a degree after 
parking, when opening and closing the door of a driver's seat, it becomes possible by 
photoing a criteria image to acquire the image which can be regarded as there being 
no obstruction as a criteria image. 

[0018] Moreover, it becomes possible to decide that it will be the back field of a car 
based on the signal from the sensor (switch) which detects the actuated valve 
position of a shift control unit for the photography stage of the criteria image which 
can be regarded as there being no obstruction, and the sensor (switch) which detects 
closing motion of the door of a drivers seat. 

[0019] According to invention according to claim 3, in addition to an operation of 
invention according to claim 1 or 2, the detected obstruction distinguishes quiescence 
body and migration body whereabouts, and recognizes an obstruction detection 
means with an obstruction recognition means. An information means distinguishes 
quiescence body and migration body whereabouts, and reports the purport of the 
existence of the obstruction detected by the obstruction detection means. 
[0020] According to invention according to claim 4, in addition to an operation of 
invention given in any 1 term of claim 1 - claim 3, an obstruction detection means 
judges whether the detection body can serve as an obstruction from the real size of 
the detection body which took into consideration the distance in the image data 
photoed by the photography means with the obstruction judging means. 
[0021] According to invention according to claim 5, in addition to an operation of 
invention given in any 1 term of claim 1 - claim 4, an obstruction detection means 
computes the anticipation retreat course of the car in an image pick-up image by 
being based on the signal of the piece angle of a steering wheel with an anticipation 
course calculation means. And the body of the anticipation retreat course computed 
by the anticipation course calculation means within the limits is detected as an 
obstruction. 

[0022] According to invention according to claim 6, while detecting as an obstruction 
the quiescence body and migration body of the anticipation retreat course by which 
the obstruction detection means was computed with the anticipation course 
calculation means in addition to the operation of invention according to claim 5 within 
the limits, the migration body of an anticipation retreat course out of range is 
detected as an obstruction. 



[0023] According to invention according to claim 7, in addition to an operation of 
invention given in any 1 term of claim 1 - claim 6, it is reported to an operator by the 
image display means as an information means that existence of an obstruction is also 
for image display. 

[0024] According to invention according to claim 8 f in addition to an operation of 
invention given in any 1 term of claim 1 - claim 7, a superposition indication of the 
information image which shows the purport which is an obstruction to the obstruction 
in the image on the screen of the image display device which displays the image of the 
back field of a car where the image display means was photoed by the photography 
means by the animation is given. 

[0025] According to invention according to claim 9, since a car equips any 1 term of 
claim 1 - claim 8 with the retreat exchange equipment of a publication, the same 
operation as invention given in any 1 term of claim 1 - claim 8 is acquired. 
[0026] 

[Embodiment of the Invention] The 1st operation gestalt which materialized this 
invention is explained based on drawing 1 - drawing 9 below <the 1st operation 
gestaltX 

[0027] As shown in drawing 5 f the camera 2 as a photography means is attached in 
the posterior part upper part location of the automobile 1 as a car. A camera 2 
contains a CCD component, and when an automobile 1 retreats, it photos the image of 
the back field shown in this drawing which covers at least the range which needs a 
back safety check with the chain line. The car-navigation system is carried in the 
automobile 1, and the LCD monitor 3 for the car navigation as an image display device 
is formed for example, on the instrument panel near the driver's seat. 
[0028] The image (photography dynamic image) of the back field of the automobile 1 
photoed with the camera 2 is expressed as this operation gestalt using the LCD 
monitor 3 for car navigation at the time of car retreat. The camera 2 is attached by 
the photography attitude angle as which a rear bumper 4 is displayed on the lower limit 
of the screen of the LCD monitor 3 in part, as shown in drawing 6 (see drawing 5 ). If 
the image processing of the image photoed with the camera 2 detects whether an 
obstruction exists in an automobile 1 before retreat initiation in car back and there is 
an obstruction about it, the retreat exchange equipment 5 which reports that to an 
operator and supports a back safety check is carried. The camera 2 and the LCD 
monitor 3 are forming some component parts of retreat exchange equipment 5. 
[0029] Drawing 3 is the block diagram showing the electric configuration of retreat 
exchange equipment 5. Retreat exchange equipment 5 is equipped with a camera 2, 
ECU6 for images, ECU7 for car navigation, the LCD monitor (a monitor is only called 
hereafter) 3, a shift position switch 8, a door switch 9, the speed sensor 10, the 
steering piece angle sensor 1 1, the speech processing circuit 12, and the loudspeaker 
13. ECU7 for car navigation and the monitor 3 have diverted what constitutes said 



car-navigation system to retreat exchange equipment 5. In addition, the monitor only 
for retreat exchange can also be prepared. 

[0030] A camera 2 is electrically connected to ECU6 for images, and the image data 
picturized by the CCD component is transmitted to ECU6 for images. As for a camera 
2, turning on and off of photography is controlled by ECU6 for images. 
[0031] While a shift position switch 8, a door switch 9, and a speed sensor 10 are 
connected through input port 14, the steering piece angle sensor 1 1 is connected to 
ECU6 for images through A/D converter 15. Moreover, ECU7 for car navigation and 
the speech processing circuit 12 are connected to ECU6 for images. A monitor 3 is 
connected to ECU7 for car navigation, and the loudspeaker 13 is connected to the 
speech processing circuit 12. 

[0032] A shift position switch 8 detects the actuated valve position of the shift lever 
16 (shown in drawing 5 ) as a shift control unit, and ECU6 for images recognizes the 
shift position SP with the output signal SPS. The automobile 1 of this operation 
gestalt is an automatic car, and there are six kinds of the shift positions SP "P, R, N, 
D, the 1st speed, and the 2nd speed/' 

[0033] A door switch 9 detects closing motion of the door 17 (shown in drawing 5 ) of 
a driver's seat, and outputs the door signal DS turned on and off according to closing 
motion of a door 17. When turning on and off of the door signal DS changes, closing 
motion of a door 1 7 is detected. 

[0034] A speed sensor 10 detects the vehicle speed and outputs the detecting signal 
vS according to the vehicle speed v. The steering piece angle sensor 1 1 detects the 
piece angle of a steering wheel 1 8 (shown in drawing 5 ). The steering piece angle 
sensor 1 1 detects the rotation of the steering shaft (not shown) which supports a 
steering wheel (handle) 19 (shown in drawing 5 ), and outputs detecting-signal thetaS 
according to the piece angle theta of a steering wheel 18. 

[0035] ECU7 for car navigation is for being built in a car-navigation system and 
managing control of a car-navigation system. ECU7 for car navigation carries out 
image display control of the monitor 3 carried in the car-navigation system. With this 
operation gestalt, ECU7 for car navigation also performs the display control of the 
image data by which an external input is carried out from ECU6 for images. 
[0036] ECU6 for images is equipped with a central processing unit (henceforth CPU) 
20, an image memory 21, and memory (for example, ROM and RAM) 22. CPU20 
operates based on the program data memorized by memory 22. In addition, a criteria 
image acquisition means is constituted by ECU6 (CPU20) for images, a shift position 
switch 8, a door switch 9, a speed sensor 10, and the image memory 21. Moreover, a 
comparison image acquisition means is constituted by ECU6 (CPU20) for images, a 
shift position switch 8, a speed sensor 10, and the image memory 21. Moreover, an 
anticipation course calculation means is constituted by ECU6 (CPU20) for images, 
and the steering piece angle sensor 11. And an obstruction recognition means, an 



obstruction judging means, an obstruction recognition means, and a superposition 
display means are constituted by ECU6 (CPU20) for images. Moreover, an information 
means is constituted by the LCD monitor 3, ECU6 (CPU20) for images, ECU7 for car 
navigation, the speech processing circuit 12, and the loudspeaker 13, and an image 
display means is especially constituted by the LCD monitor 3, ECU6 (CPU20) for 
images, and ECU7 for car navigation. 

[0037] There are program data for performing for example, retreat exchange 
processing in memory 22. Here, retreat exchange is an image processing's detecting 
the body which serves as an obstruction at the time of retreat of an automobile 1 , and 
warning an operator with voice and an image, and is a system for reducing the 
accident at the time of retreat. When an operator considers that there is no 
obstruction in back, opens and closes a door 17 and specifically gets in a driver's seat, 
the change of a situation of car back until an automobile 1 begins to move back is 
detected from from, it is that voice and an image report existence of an obstruction to 
an operator, and the safety check of back until it begins to retreat is supported. 
[0038] With this operation gestalt, while a shift position is in "R", the image of the 
back field of a car projects on screen 3a of a monitor 3, and a superposition indication 
(super imposing) of the rectangle surrounding it is given to the obstruction in the 
image of screen 3a as the information approach by the image. CPU20 is equipped with 
the buffer for the rectangle display process which indicates the rectangle surrounding 
the detected obstruction by superposition. That is, image data can be equipped with 
five buffers which can be saved every one frame for the data for indicating the 
rectangle by superposition, and the data about a rectangle can be saved by five 
frames. 

[0039] A comparison image is serially photoed during a stop until it acquires 
beforehand one criteria image in case it may be considered that an obstruction does 
not exist and a car begins to run by retreat exchange processing at the time of retreat, 
and the image processing which compares with a criteria image the comparison image 
obtained serially using a background finite difference method is carried out. And only 
the part which was changeful between the criteria image and the comparison image is 
extracted, and an obstruction is detected. Obstruction detection performs even 
discernment (recognition) from a "quiescence body" and "those with a migration 
body." For this reason, two kinds of voice data required for memory 22 in order to 
carry out voice information is remembered to be the object for quiescence body 
information and the object for migration body information according to these two 
kinds of recognition results. Moreover, the program data for a rectangle display 
process are memorized by memory 22, and a rectangular superposition display is 
made by the rectangle display process in two kinds of modes according to these two 
kinds of recognition results mentioned later. 

[0040] Drawing 4 is drawing explaining the flow of the obstruction detection in retreat 



exchange processing. With this operation gestalt, the image when operating a shift 
lever 16 in parking (parking location) "P" or a neutral (center valve position) "N" is 
adopted as a criteria image ImageO after a car halt. Moreover, an image when a door 
17 is opened and closed is updated as a criteria image ImageO. That is, the time of 
parking and stopping and the time of the door 17 of a driver's seat being opened and 
closed are adopted as a condition which can be regarded as there being no 
obstruction in back. It is because it can consider that an obstruction does not exist at 
these times. 

[0041] Since the image of the back is equivalent to the location the car has run now 
when it parks and stops, it can be considered that there is no obstruction in the back 
immediately after stopping and parking. Then, in order to obtain the back image 
immediately after stopping and parking, he is trying to obtain a back image when a shift 
lever 16 is operated by "P" or "N" as a criteria image after a stop (vehicle speed v= 0). 
[0042] Moreover, it is because the back of a car is once checked when it has come 
back in order to ride after an operator gets down in the time of an operator getting on 
and off when the door 1 7 of a driver's seat is opened and closed, so it can consider 
that there is no obstruction back. After parking and stopping, the criteria image 
ImageO is updated because there is a time of time amount having passed by the time it 
begins retreat. At this time, the light sources, such as a difference between daytime 
and night, have a big change, and when a back image when a shift lever 1 6 is operated 
by "P" or "N" is used as the criteria image ImageO, there is a possibility that incorrect 
detection may arise. Therefore, he is trying to update a back image when a door 1 7 is 
opened and closed as a criteria image ImageO. 

[0043] And after photography (time of day to) of the criteria image ImageO, if a shift 
lever 16 is put into "R" (time of day t1), the comparison image Imagen (n= 1, 2 and 3, 
— ) will be serially photoed to every predetermined time deltat (for example, 33 - 66 
ms). whenever [ which acquires one comparison image Imagen ] — the criteria image 
ImageO and a comparison image — Imagen — difference — the image processing to 
process is performed, a "quiescence body" and "those with a migration body" are 
distinguished, and an obstruction is detected. If a car begins to retreat and the vehicle 
speed v is no longer zero (v!=0), retreat exchange processing will be suspended. 
[0044] Drawing 1 and drawing 2 show the program data of retreat exchange 
processing with a flow chart. Cognition of that the automobile 1 stopped based on the 
detecting signal vS from a speed sensor 10 (v= 0) performs the program data of 
retreat exchange processing by CPU20. 

[0045] The flow chart shown in drawing 1 is processing for photoing the criteria image 
ImageO. The flow chart shown in drawing 2 is an obstruction information manipulation 
routine performed after a shift lever 16 is operated by "R" until a car begins to move. 
If put into the shift position SP by "R", photography of the comparison image Imagen 
with a camera 2 will be started, and screen 3a of a monitor 3 will be switched to the 



image of the car back which a camera 2 photos. While the shift position SP is in "R", a 
back image projects on screen 3a of a monitor 3. Retreat exchange processing is until 
a car begins to retreat, but even if a car begins to move, a back image projects it on 
screen 3a of a monitor 3 during retreat. If the processing which projects a back image 
on screen 3a of a monitor 3 by the animation is put into the shift position SP by "R", 
it will be carried out because CPU20 executes a main program, and an obstruction 
information manipulation routine will be performed as interruption processing of this 
main program. An obstruction information manipulation routine becomes the Lord of 
obstruction detection, obstruction recognition, voice warning, and a rectangle 
superposition display from 4 processings. 

[0046] Hereafter, the program of retreat exchange processing is explained according 
to the flow chart of drawing 1 and drawing 2 . It is processing for photoing the image at 
the time of being in the condition which can be regarded as the processing to step 10 
- step 60 not having an obstruction in back as a criteria image ImageO. 
[0047] At step 10, it judges whether the shift position SP is "P" or "N." If the shift 
position SP is "P" or "N", it will progress to step 20. If the shift position SP is not "P" 
or "N", either, the standby which repeats processing as it is will be carried out. The 
processing concerned is ended when it becomes the vehicle speed v!=0 waiting. 
[0048] The criteria image ImageO is photoed at step 20. That is, CPU20 makes a 
camera 2 turn on and memorizes the criteria image ImageO of one sheet (one frame) 
transmitted from the camera 2 to the predetermined storage region of an image 
memory 21. 

[0049] At step 30, it judges whether the door 17 of a driver's seat was opened and 
closed. That is, it judges whether CPU20 had the change rate of turning on and off of 
a door switch 9. When it is judged that the door 17 was opened and closed, it 
progresses to step 40, and when a door 17 is not opened and closed, it progresses to 
step 50. 

[0050] The criteria image ImageO is updated at step 40. That is, CPU20 makes a 
camera 2 turn on, and memorizes and updates the criteria image ImageO of one sheet 
transmitted from the camera 2 to the predetermined storage region of an image 
memory 21. 

[0051] At step 50, it judges whether the shift position SP is "R." It progresses to an 
obstruction information manipulation routine at the time of SP=R. When it is not SP=R, 
it progresses to step 60. 

[0052] At step 60, it judges whether the shift position SP is "P" or "N." If the shift 
position SP is "P" or "N", it will progress to step 30 and processing of S30-S60 will 
be repeated. That is, the processing for updating the criteria image ImageO at the time 
of closing motion of a door 1 7 is repeated until the shift position SP is set to "R" or it 
becomes except "P" and "N." On the other hand, the processing concerned will be 
ended if the shift position SP turns into positions other than "P", "N", and "R." 



[0053] Next, the program of the obstruction information manipulation routine 
performed when it is judged that the shift position SP is "R" in step 50 is explained 
according to drawing 2 . This routine consists of four main processings mentioned 
above, and, for obstruction detection processing and step 1 20, obstruction recognition 
processing and step 130,140 are [ step 70 - step 110 / a voice warning process and 
step 1 50 ] rectangle superposition display processing (obstruction rectangle display 
processing). 

[0054] the obstruction detection processing which consists of step 70 - step 110 — 
comparison image photography and difference — it consists of each processing of 
processing, anticipation retreat field calculation processing, threshold processing, and 
obstruction detection, and every predetermined time deltat performs serially. It 
restricts to the time when the obstruction was detected from this obstruction 
detection processing result, and progresses to obstruction recognition processing of 
step 120. Obstruction recognition processing is processing which recognizes a 
"quiescence body" and "those with a migration body." Either of the following step 
130,140 is chosen according to the recognition result, and voice warning according to 
a recognition result is performed. And at step 150, processing which indicates the 
rectangle surrounding it to the obstruction in the image (dynamic image) projected on 
screen 3a of a monitor 3 by superposition (super imposing) is performed. 
[0055] Steps 170 and 180 are processings for judging whether the routine concerned 
is continued, and they continue the routine concerned until a car begins to move, or a 
shift lever 16 is changed into positions other than "R" and it grazes. Therefore, it 
judges whether the vehicle speed v is zero (v= 0), and judges whether the shift 
position SP is "R" (SP=R) by S180 S170. 

[0056] Hereafter, the obstruction detection processing (S70-S110) which are the 
main processings of an obstruction information manipulation routine, obstruction 
recognition processing (S120), a voice warning process (130,140), and rectangle 
superposition display processing (obstruction rectangle display processing) (S1 50) are 
explained in full detail. 

[0057] (Obstruction detection processing) Obstruction detection processing is 
explained first. At step 70, the comparison image Imagen is photoed first. CPU20 
inputs the data of the comparison image Imagen of one sheet (one frame) transmitted 
from the camera 2. 

[0058] the difference which compares the image ImageO of two sheets, and Imagen at 
step 80 — it processes. CPU20 carries out the image processing according [ accord / 
the criteria image ImageO / read-out and the image ImageO of two sheets / CPU ] 
Imagen to a background finite difference method from an image memory 21. For 
example, the absolute value (|lmagen-lmage0|) of the difference of Imagen and ImageO 
is taken, and expansion processing is performed to the subtraction image. Even if one 
body is divided into plurality by this in the part (for example, umbra by the shadow) 



where brightness differs, it combines with the one original body. Next, threshold 
processing using a predetermined threshold is performed and a binary picture is 
obtained. By binary picture data, a part which is different by ImageO and Imagen is 
expressed as a white field (data "1"). x 
[0059] It asks for the anticipation retreat field (anticipation retreat course) PA in case 
a car retreats at step 90. Signal value thetaS from the steering piece angle sensor 1 1 
is read, and the anticipation retreat course PA on a binary picture is searched for 
based on the piece angle theta of the steering wheel 18 obtained from the signal value 
thetaS. The formula beforehand memorized by memory 22 is used for calculation of 
the anticipation retreat course PA. In consideration of the distance on a binary picture, 
the equation of two or more curves, such as an ellipse and a parabolic curve, etc. is 
used for a formula. Drawing 6 is what showed the binary picture Image typically, and 
the anticipation retreat course PA is searched for as a field across which it faced in 
two Rhine (the chain line shows in this drawing) decided from a formula. As shown in 
drawing 6 (a), on the piece square theta at the time of rectilinear propagation (= 0), a 
long distance serves as straight stretch ****** so that, as for the anticipation retreat 
course PA, width efface may become narrow. Moreover, as shown in drawing 6 (b), on 
the piece square theta when turning a wheel 1 9 (theta> 0 or theta< 0), the anticipation 
retreat course PA serves as a field describing the curve to which width of face 
becomes narrow like a long distance. Moreover, the width of face of the anticipation 
retreat course PA is almost equal to breadth of a car. In addition, at drawing 6 (a), not 
a white field but black shows the detection body. 

[0060] At step 100, threshold processing which extracts an obstruction from a 
detection body based on size (detection) is carried out. Only that to which real size 
exceeds predetermined size is detected as an obstruction. As shown in drawing 6 , the 
field of the anticipation retreat course PA in a binary picture Image is first classified 
into the block B of plurality (three [ for example, ]) according to a far and near 
difference, and the size comparison with the area value of the white field (black in 
drawing 6 (a)) where a part also exists in the block B in each the block B of every, and 
a threshold is carried out using the threshold set to each the block B of every. When 
the area of a white field exceeds a threshold, it judges with it being the body of size 
with which the white field can serve as an obstruction. About the white field of the 
area exceeding a threshold, the number of detection of a white field, the main 
coordinate of each white field, the coordinate of the starting point (upper left point) of 
the rectangle surrounding each white field, width of face, and height are found, and the 
data is memorized to one of five buffers (buffer for the newest time of day). To five 
buffers, the data for the five past (it contains this time also) are memorizable. The 
outside field OA of the anticipation retreat course PA shown in drawing 6 out of range 
is not made into the object of obstruction detection, and the body which exists in the 
outside field OA is not detected as an obstruction. 



[0061] At step 1 10, it judges whether the obstruction was detected or not. That is, it 
judges whether the white field where an area value exceeds a threshold at a front step 
existed. When an obstruction is not detected, it progresses to step 1 70, and when an 
obstruction is detected, it progresses to obstruction recognition processing of step 
120. In addition, since two kinds of data obtained by each obstruction detection 
processing in the last time of day t-1 and this time of day t are required for 
obstruction recognition processing, shifting to obstruction recognition processing, 
when it is judged that the obstruction was detected at the step 110 concerned is 
restricted to the processing cycle after a two-times eye (n>=2). 

[0062] (Obstruction recognition processing) Drawing 7 is used and explained about 
obstruction recognition processing of step 120 below. In obstruction recognition 
processing, an obstruction recognizes a "quiescence body" and "those with a 
migration body" (discernment). 

[0063] The data of the number of obstruction detection and the data of the main 
coordinate of each obstruction in last time and this time are first read from a buffer 
(two buffers (the object for the newest time of day, and the object for last time)). Here, 
the number of detection of the obstruction (white field) in the last time of day t-1 and 
this time of day t is set to Nt-1 and Nt, respectively. Moreover, each time of day t-1 
and the main coordinate of each obstruction (white field) in t are set to Ck, t-1 
(however, k= 1, 2, — , Nt- 1), and Ck and t (however, k= 1, 2, — , Nt), respectively. Here, 
the number which specifies an obstruction [ in / in the front subscript k / each 
frame ], and a next subscript show time of day. Processing of following ** and ** is 
performed one by one using these two kinds of data. 

[0064] ** Compare the number of detection, if it becomes Nt-1 !=Nt — " — a 
migration body — it is — " — ** — it carries out. For example, when the numbers of 
detection differ [ detection number Nt-1 of time of day t-1 ] in the number Nt of 
detection of time of day t by "1 " as shown in "2" as shown in drawing 7 (a) (i.e., when 
there is a change in the number of detection at time of day t and time of day t-1), a 
migration body surely exists, therefore, the time of Nt-1 !=Nt being materialized — 
" — a migration body — it is — " — ** — it carries out. 

[0065] ** Compare each time of day t-1 and the main coordinate of the obstruction in 
t at the time of Nt-1=Nt. When there are two or more bodies detected at time of day 
t and time of day t-1, since distinction of each body of inter-frame and each is 
difficult, it compares a main coordinate about all combination. For example, if the 
combination of the main coordinate Ck of time of day t-1, t-1, and the main 
coordinates Ck and t of time of day t is set with Ck, t-1 , and (Ck, t) C1 , t-1 , (C2, t), — , 
(CNt, t), [ C1 , t-1 , (C1 , t), ] [ C1 , t-1 , ] C2, t-1 , (C2, t), — , (CNt, t), [ C2, t-1 , (C1 , t), ] 
[ C2, t-1, ] It investigates about all combination like CNt-1, t-1, and (CN, t). [ CNt-1, 
t-1 , (C2, t) --, and ] [ CNt-1 , t-1 , (C1 , t) ] [ — , ] It supposes that it obtains whether 
the comparison of a main coordinate is in agreement, and asks for the number Ne of 



the combination whose main coordinates investigates all combination and correspond 
(henceforth the number of coincidence). 

[0066] As shown in drawing 7 (b), while all bodies are standing it still, since the main 
coordinate of each body changes at time of day t and time of day t-1 and is the same, 
the number Ne of coincidence becomes equal to the number Nt (=Nt-1) of detection. 
Therefore, only a "quiescence body" will be recognized if Ne=Nt (this example Ne=Nt= 
2) is materialized. Moreover, since the main coordinate of a migration body changes at 
time of day t-1 and time of day t when a migration body exists as shown in drawing 7 
(c), the number Ne of coincidence surely becomes less than the number Nt of 
detection. Therefore, if Ne!=Nt (this example 1=Ne!=Nt= 2) is materialized, it will be 
recognized as "those with a migration body." In addition, the location and magnitude 
of an obstruction (white field) which are detected are giving a certain amount of 
tolerance to the judgment of coincidence of a main coordinate in consideration of the 
error which light hits and swings by the difference of the direction etc. 
[0067] If it is only a "quiescence body", it will progress to step 130, and if the 
judgment result in processing of this step 120 is "with a migration body", it will 
progress to step 1 40. 

(Voice warning process) A voice warning process is explained below. 
[0068] Voice warning for quiescence bodies is performed at step 130. CPU20 reads 
the voice data for quiescence bodies from memory 22, and transmits it to the speech 
processing circuit 12. Voice warning is carried out to an obstruction being in "course 
from a loudspeaker 13 based on voice data." That is, the voice of the contents which 
the purport which is a quiescence body understands reports. 

[0069] Voice warning for migration bodies is performed at step 140. CPU20 reads the 
voice data for migration bodies from memory 22, and transmits it to the speech 
processing circuit 12. Voice warning is carried out to an obstruction going into 
"course from a loudspeaker 13 based on voice data." That is, the voice of the 
contents which the purport which is a migration body understands reports. The degree 
of a voice warning process progresses to step 1 50. 

[0070] (Rectangle superposition display processing) Obstruction rectangle display 
processing (rectangle superposition display processing) of step 150 is explained below. 
It is the processing which indicates the rectangle surrounding an obstruction to the 
image of screen 3a of a monitor 3 by superposition (superimposition). That is, 
highlighting of the obstruction in an image is carried out. Under the present 
circumstances, an obstruction blinks a rectangle at the time only of a "quiescence 
body", and it is made to move at the time "with a migration body", so that a rectangle 
may be made to follow in footsteps of a migration body. Thus, the rectangular display 
mode is changed a "quiescence body" and "with the migration body." 
[0071] Hereafter, rectangle superposition display processing is explained according to 
drawing 8 and drawing 9 . CPU20 uses the data for the five past containing this time 



memorized by five buffers, and carries out control processing of rectangular display 
and elimination. First a rectangular display is performed each time and the rectangle 
is indicated by superposition based on the data (the rectangular starting point width 
of face, height data) of five buffers. It is carried out only at the time of parameter 
disp=1 by which rectangular elimination was stored in the oldest buffer only when 
rectangular data were stored in the oldest (time of day t-4) buffer. 
[0072] Drawing 8 image-data-izes the data for every frame which can be saved at 
each buffer, and shows them typically. It is each buffer of time of day t t-1, — , t-4 
from the right in this drawing at order, these new data are saved at the buffer of the 
time of day t by the side of the rightmost in this drawing, and whenever data with new 
consecutiveness are inputted, each data moves to the buffer on the left of one (even 

— time of day — old) in order (whenever it goes through deltat). 

[0073] As data saved at a buffer, two parameters disp and still are added from the 
processing concerned. Parameter disp is for judging whether the rectangle is 
displayed or not, and if a rectangle is displayed and "1" and a rectangle will be 
eliminated for Parameter disp, it will set Parameter disp to "0." Moreover, Parameter 
still is for distinguishing a "quiescence body" and "those with a migration body", and 
sets Parameter still to "0" for Parameter still at the time "1" and "with a migration 
body" at the time only of a "quiescence body." In addition, unless the rectangle 
displayed at time of day t is eliminated, the display is continued until time of day t-4 
comes (between 5 and deltat). 

[0074] Two kinds of different display modes of rectangular flashing and imitation are 
brought about by the difference in the method of elimination when eliminating a 
rectangle. It performs only at the time of parameter disp=1 by which this rectangle 
elimination processing was stored in the oldest (time of day t-4) buffer, and the 
method of elimination changes with differences in the value of the parameter still of 
the oldest buffer. Hereafter, rectangle elimination processing is explained using 
drawing 8 (a) and (b). 

[0075] ** the case ( drawing 8 (a)) ( ) of only a quiescence body 

If it is parameter disp=1 first stored in the oldest (time of day t-4) buffer, it will be 
referred to as parameter disp=0 while eliminating rectangle data. Next, the parameter 
still in the time of day t-4 is seen, only a "quiescence body" is shown — if it becomes 
still=1 , it will move to the buffer of the time of day t-3 new [ one ], and it is referred to 
as disp=0 while eliminating rectangular data, if it becomes disp=1. the time of day t-3 

— if it becomes parameter still=1, it will move to a buffer new [ one more ], and the 
same processing as the following will be repeated. The rectangle data which show the 
rectangle of a quiescence body by this are once eliminated altogether by processing in 
all buffers. Therefore, since the rectangle display of a quiescence body is eliminated 
once by 5 times, as shown in drawing 9 (a), in the case of only a "quiescence body", 
the rectangle R surrounding the quiescence body SS which is an obstruction serves 



as a flashing display. 

[0076] ** a case with a migration body ( drawing 8 (b)) ( ) 

If it is parameter disp=1 first stored in the oldest (time of day t-4) buffer, it will be 
referred to as parameter disp=0 while eliminating rectangle data. Next, the parameter 
still in the time of day t-4 is seen. When it is still=0 which shows "those with a 
migration body", it does not move to a new buffer and only the rectangle data of the 
oldest (time of day t-4) frame are eliminated. Only the thing always oldest in the 
rectangle of a migration body is eliminated for this processing. Consequently, as 
shown in drawing 9 (b), in the case of "with a migration body", the rectangle R 
surrounding the migration body MS which is an obstruction follows in footsteps and 
moves to the migration body MS. That is, the rectangle of the five past is displayed 
into the image of screen 3a. In addition, about the quiescence body which lives 
together in the case of "with a migration body", flashing is not carried out only by a 
superposition indication of the rectangle being given. Of course, the processing which 
blinks the rectangle of a quiescence body is employable. 

[0077] Next, an operation of retreat exchange equipment 5 is explained. If a car stops 
and it is put into a shift lever 16 by "N" and "P", the criteria image ImageO of one 
sheet will be photoed with a camera 2. Then, whenever the door 1 7 of a driver's seat is 
opened and closed, the criteria image ImageO is updated. The image of the nearest 
stage that can be regarded as there being no obstruction in car back by these 
processings is memorized as a criteria image ImageO in an image memory 21. 
[0078] Here, in the case of stopping and parking, by the time it next begins to retreat 
a car, an operator may get down from a car, or it may not get down. When the image 
when putting a shift lever 16 into "P" or "N" when an operator does not get down 
from a car is used as the criteria image ImageO and an operator gets down from a car, 
let an image when the door 17 of a driver's seat is opened and closed be the criteria 
image ImageO. It can be considered that there is no obstruction in car back when a 
shift lever 16 is operated by "P" or "N" immediately after stopping and parking since 
the back is the location along which it has passed now when a car is made to park and 
stop in the case of the former. Moreover, since in the case of the latter an operator 
checks car back once when finishing business and returning and taking a car, in order 
that an operator may ride on a car, when a door 17 is opened and closed, it can be 
considered that there is no obstruction in car back. Therefore, an image in case there 
is no obstruction is obtained as a criteria image ImageO. The processing so far is 
performed based on the program shown with the flow chart of drawing 1 . 
[0079] Next, if a shift lever 16 is put into "R" in order that an operator may retreat a 
car, the image of the car back photoed with the camera 2 will project on screen 3a of 
a monitor 3. That is, screen 3a of a monitor 3 switches to the image of car navigation 
screen empty vehicle both back. Moreover, the obstruction information manipulation 
routine shown with the flow chart of drawing 2 is performed at the same time it is put 



into a shift lever 16 by "R. 

[0080] That is, the comparison image Imagen (n= 1, 2, — ) is photoed by every 
predetermined time deltat, the image processing which uses the criteria image ImageO 
and the comparison image Imagen (n= 1 t 2, — ) for whenever [ the ], and compares a 
background finite difference method with it is performed, and obstruction detection is 
performed within the limits of the anticipation retreat course PA decided from the 
piece angle theta of a steering wheel 18. If an obstruction is detected in the 
anticipation retreat course PA, an obstruction will recognize a "quiescence body" and 
"those with a migration body." 

[0081] While "An obstruction is in a course" is warned with voice from a loudspeaker 
13, a flashing indication of the rectangle which surrounds an obstruction in the image 
of screen 3a is given by the case of only a "quiescence body" (see drawing 9 (a)). On 
the other hand, in the case of "with a migration body", the rectangle surrounding an 
obstruction is displayed into the image of screen 3a, and the rectangle follows in 
footsteps and moves to a migration body while "An obstruction goes into a course" is 
warned with voice from a loudspeaker 13 (see drawing 9 (b)). 

[0082] For this reason, in order that an operator may retreat a car, even if it turns 
back and lets screen 3a of a monitor 3 out of sight, it can distinguish and grasp 
whether that obstruction is a quiescence body and whether it is a migration body as 
existence of an obstruction by audio warning. For example, it can discover, without a 
quiescence body's being in the dead angle for an operator, or overlooking the 
obstruction, when [ at which the migration body invaded ] it comes when back is 
turned. 

[0083] Moreover, since the rectangle which surrounds it with the obstruction in the 
image of screen 3a is displayed in addition to voice warning while seeing screen 3a and 
performing the back safety check, it becomes, without overlooking the obstruction in 
the image of screen 3a. Furthermore, since a rectangle will blink if an obstruction is 
only a "quiescence body", and a rectangle will follow in footsteps and move to a 
migration body if it is "with a migration body", it is easy to grasp even the property of 
an obstruction, and its trend. 

[0084] thus, after an operator makes a car park and stop, when not getting down From 
the time of putting a shift lever 16 into "P" or "N", when an operator gets down from 
a car Since warning will be emitted by voice and the rectangle display in the image of 
screen 3a to an operator if change of a situation until a car begins to move is detected 
and there is an obstruction from from when a door 17 is opened and closed With 
exchange by voice and the image, back becomes possible [ carrying out retreat start 
of the car in the certainly safe condition ]. 

[0085] Although the program of retreat exchange processing will be ended if a car 
begins to retreat (vehicle speed v!=0), the image of car back projects on screen 3a of 
a monitor 3 succeedingly during retreat of a car. Therefore, safe operation can be 



performed, grasping a back situation through the image of screen 3a also during car 
retreat. For example, there is no fear of applying the posterior part of a car to a wall 
etc. at the time of vehicle warehousing. If a shift lever 16 is switched to other 
locations (for example, "P", "N", etc.) from "R", screen 3a of a monitor 3 will be 
switched to the original image from the image of car back. In addition, also when a shift 
lever 16 is switched to other locations from "R" before the car retreated, the program 
of retreat exchange processing is ended and screen 3a of a monitor 3 is switched to 
the original image from the image of car back. 

[0086] According to this operation gestalt, the following effectiveness is acquired as 
explained in full detail above. 

(1) In order to retreat a car, when a shift lever 16 is operated to "R" and it is not 
getting down after an operator makes a car park and stop From the time of putting a 
shift lever 16 into "P" or "N", when an operator gets down from a car If an image 
processing detects the change of a situation of car back until a car begins to move 
and an obstruction exists on the retreat course of a car from from when a door 1 7 is 
opened and closed That can be reported to an operator through the superposition 
display (super imposing) displayed on the location of the obstruction in the image of 
screen 3a of voice and a monitor 3. Since the superposition display (super imposing) 
which shows that to the obstruction in the image projected on screen 3a of a monitor 
3 is made compared with the back monitor stated with the conventional technique, an 
obstruction is not overlooked probably. Moreover, since an operator will receive 
warning from both an acoustic sense and vision by voice warning and superposition 
display (super imposing), overlooking of an obstruction is further avoidable. Moreover, 
even if it lets screen 3a of a monitor 3 out of sight, overlooking of an obstruction is 
avoidable by making voice warning. 

[0087] (2) Since the anticipation retreat course PA of a car is searched for from the 
piece angle theta of a steering wheel 18 and only the range of the anticipation retreat 
course PA is made into the range for detection of an obstruction, only the obstruction 
on the retreat course according to the piece angle theta at that time can be reported 
to an operator. That is, only what can serve as an obstruction can be discovered 
certainly. 

[0088] (3) Since an obstruction recognizes a "quiescence body" and "those with a 
migration body" and reports a "quiescence body" and "those with a migration body" 
in distinction from an operator, an obstruction is what kind of thing, or an operator 
tends to grasp the property and trend. 

[0089] (4) since consider super imposing as the rectangle display surrounding an 
obstruction, a quiescence body is made to blink a rectangle and it was made to make a 
rectangle follow in footsteps of a migration body — rectangular display voice — it can 
distinguish whether an obstruction is a quiescence body at a glance or it is a migration 
body by difference [ like ]. 



[0090] (5) Since super imposing is a frame display called the rectangle surrounding an 
obstruction, an obstruction hardly hides with a rectangle but it can identify what the 
obstruction is (check by looking). 

(6) By voice warning, when obstructions are "an obstruction is in a course'', and with 
a migration body only in the case of a quiescence body, warn "An obstruction goes 
into a course." Therefore, an operator can distinguish and recognize that by which the 
obstruction has invaded into what stands it still on a course, and a course by hearing 
voice warning, even when it lets screen 3a of a monitor 3 out of sight. 
[0091] (7) Since the image of car back projects on screen 3a of a monitor 3 
succeedingly even after a car begins to retreat, the situation of car back can be firmly 
grasped by seeing screen 3a of a monitor 3 during retreat. For this reason, although 
detection and information of an obstruction are no longer made since a car begins to 
retreat, a back safety check can be performed by seeing screen 3a of a monitor 3. 
[0092] (8) Although the monitor 3 of a car-navigation system is used for retreat 
exchange equipment 5, since the screen of a monitor 3 only switches to a back image 
at the time of car retreat, when using a car-navigation system, there is especially no 
trouble. Moreover, since the monitor 3 of a car-navigation system is used, it is not 
necessary to prepare an exclusive monitor and retreat exchange equipment 5 can be 
carried in an automobile 1 at cheap cost. 

[0093] (9) Since the time of being put into a shift lever 16 by "P" or "N" and the time 
of the door 1 7 of a driver's seat being opened and closed after that were adopted as a 
stage to photo the criteria image ImageO, the suitable criteria image ImageO at the 
time of being in the condition which does not have an obstruction in car back can be 
obtained almost certainly. Therefore, the leakage in detection of an obstruction and 
incorrect detection of an obstruction can be reduced as much as possible, and 
detection precision of an obstruction can be made high. 

[0094] (10) Since the criteria image ImageO is updated whenever it opens and closes 
the door 17 of a drivers seat, the incorrect detection by the difference in the light 
source etc. can be prevented. For example, after an operator leaves a car after 
parking, considerable time amount passes and the hit condition of the light of the 
scene of car back changes completely, the operator who has returned to the car may 
retreat a car. Even in such a case, even when considerable time amount passes after 
parking and stopping before retreating a car since it becomes the image processing 
with which the hit condition of light compares the criteria image ImageO of the same 
background, and the comparison image Imagen since the criteria image ImageO is 
updated when a door 17 is opened and closed, in order that an operator may return 
and take a car, incorrect detection of an obstruction can be avoided. 
[0095] (1 1) It divides into two or more blocks B which depend image data on a far and 
near difference, and since the obstruction detection approach of extracting the thing 
of the size which can serve as an obstruction among detection bodies using the 



threshold of each the block B of every is taken, only the thing exceeding the fixed size 
from which size can serve as an obstruction as a matter of fact among detection 
bodies can be judged as an obstruction. 

[0096] <The 2nd operation gestalt>, next the 2nd operation gestalt are explained using 
drawing 10 and drawing 1 1 . This operation gestalt is the example which changed a 
part of obstruction information manipulation routine in said 1st operation gestalt. Even 
if the anticipation retreat course PA is out of range, he is trying to detect as an 
obstruction about a migration body with this operation gestalt, although not detected 
as an obstruction with said 1st operation gestalt about a body [ that the anticipation 
retreat course PA is out of range (outside field OA) ]. In order that an operator may 
retreat a car, when it looks back upon this back, it is for reporting to an operator that 
there is a migration body which it turns round, and a dead angle tends to be made in a 
direction and the opposite side, and is going to enter in a course in such a dead angle. 
[0097] As shown in drawing 1 1 , the obstruction information manipulation routines of 
this operation gestalt are the contents of processing as said 1 st operation gestalt with 
same steps 70 and 80 and steps 150-170. Hereafter, different processing from the 1st 
operation gestalt is explained. 

[0098] Threshold processing of step 200 is performed in all the range of a binary 
picture Image. That is, all the range of a binary picture Image is classified into two or 
more blocks B according to a far and near difference, and the size comparison with 
the area value of a detection body (white field) and a threshold is carried out to every 
block B using the threshold set up for every block. It is aimed at all image range to said 
1st operation gestalt (S100) having targetted only the inside of the anticipation 
retreat course PA. 

[0099] At step 210, it judges whether the obstruction was detected by processing of 
steps 70 and 80,200. Detection of an obstruction is made, even if all photography 
range is made into the object range of obstruction detection and sticks out of range 
[ the anticipation retreat course PA ] this time. If an obstruction is detected, it will 
progress to step 210 and an obstruction will not be detected, it progresses to step 
160. 

[0100] Obstruction recognition processing is performed at step 220. That is, an 
obstruction judges a "quiescence body" and "those with a migration body." This 
judgment approach is the same as that of said 1st operation gestalt, and it differs in 
that the object range of obstruction recognition is all photography range. If it is only a 
"quiescence body", it will progress to step 230, and if it is "with a migration body", it 
will progress to step 260. 

[0101] At step 230, the anticipation retreat field (anticipation retreat course) PA is 
computed. This calculation approach is the same as step 90 in said 1st operation 
gestalt. At the following step 240, it judges whether a quiescence body exists in the 
anticipation retreat course PA. When a quiescence body does not exist in the 



anticipation retreat course PA, it progresses to step 1 60. That is, it is not considered 
that the quiescence body of the outside field OA is an obstruction, and it is not made 
into the object of information. On the other hand, when a quiescence body exists in 
the anticipation retreat course PA, it progresses to the following step 250, and it 
warns of the purport to which an obstruction exists on a course with voice. 
[0102] On the other hand, at step 260, it warns of the purport in which the obstruction 
of a migration body exists with voice. In this case, since the migration body which 
exists in the outside field OA in the anticipation retreat course PA serves as an 
obstruction, the contents of voice are considered as warning of the purport in which 
the obstruction which went into the course or has a possibility of going into a course 
exists. 

[0103] Next, although it is the translation from which it moves to obstruction 
rectangle display processing (rectangle superposition display processing), let only a 
migration body be an obstruction among the detection bodies of the outside field OA 
with this operation gestalt. Therefore, it is necessary to eliminate the data (rectangle 
data) about the quiescence body of the outside field OA. That is, in threshold 
processing of step 200, the data (the number of detection, a main coordinate, the 
rectangular starting point, width of face, height, etc.) of the detection body of all image 
range are saved at the buffer. Therefore, it is necessary to eliminate the rectangle 
data (the rectangular starting point, width of face, height, etc.) about the quiescence 
body of the outside field OA among data. The anticipation retreat course PA is used 
for identifying the rectangle data to eliminate (step 230,270), at step 280, a main 
coordinate is out of the anticipation retreat course PA, it considers that a detection 
body with the combination whose main coordinate corresponds at time of day t-1 and 
time of day t is the quiescence body of the outside field OA, and the rectangle data 
about the quiescence body are eliminated. In addition, since it is necessary to use it 
for next obstruction recognition processing or rectangle data elimination processing, 
the data of the number of detection or a main coordinate are not eliminated. 
[0104] And at step 150, rectangle display processing is performed like said 1st 
operation gestalt. A rectangle blinks the case of only a "quiescence body" while a 
superposition indication of the rectangle which surrounds it with the obstruction 
which exists in the anticipation retreat course PA like said 1st operation gestalt is 
given. In the case of "with a migration body", a rectangle follows in footsteps and 
moves to a migration body while a superposition indication of the rectangle which 
surrounds it on the migration body which exists within the limits of the anticipation 
retreat course PA and outside the range is given. 

[0105] For example, if the migration body MS which is going to go into the anticipation 
retreat course PA is in the outside field OA as shown in drawing 10 , on the image 
projected on screen 3a of a monitor 3, it will be displayed that the rectangle R 
surrounding this migration body MS follows in footsteps of this migration body MS. For 



this reason, an operator can discover the migration body MS with a possibility of 
invading in a retreat course through the image of screen 3a, at a glance. 
[0106] As explained in full detail above, according to this operation gestalt, the 
effectiveness of (1) - (1 1) stated with said 1st operation gestalt is acquired similarly, 
and also the following effectiveness is acquired. 

(12) Voice and an image can report a migration body with a possibility of invading in a 
retreat course to an operator. For this reason, attention can be paid to a migration 
body with a possibility of invading into a retreat course in case a car is retreated. For 
example, when an operator turns round back in order to retreat a car after carrying 
out a safety check by screen 3a and there is a migration body which is going to turn 
round and is going to enter on a retreat course at the dead angle of a direction and the 
opposite side, you can notice the migration body with voice. 

[0107] In addition, an operation gestalt is not limited above but can also be carried out 
in the following modes. 

O The stage to photo the criteria image ImageO is not limited to said each operation 
gestalt. For example, you may be only a time of being put into a shift lever 16 by "P" 
or "N." Only when it furthermore puts into V, only the time of putting into "P" can 
also be adopted. An obstruction is detectable although the criteria image ImageO is 
not updated in these cases depending on closing motion of the door 17 of a drivers 
seat. Moreover, when a door 17 is opened and closed after that with the time of 
detecting "N", the time of a door 17 being opened and closed after that with the time 
of detecting "P" can also be adopted. Moreover, if the time of being in the condition 
which can be regarded as there being no obstruction can be set as car back, a criteria 
image can also be photoed based on the signal from the sensor which detects that the 
other actuation objects operated by the operator were operated, a switch, or the 
sensor which detects specific actuation of an operator and a switch. For example, as a 
former sensor, the sensor which detects actuation of a hand brake lever is mentioned, 
and the seat sensor which detects the operator having got in the car and having sat 
on the seat as a latter sensor is mentioned. 

[0108] O When photoing a criteria image, the image of two or more sheets can be 
photoed, and it can check that there is no migration body in car back by recognition 
processing, and the approach of choosing an image when the migration body does not 
exist as a criteria image can be adopted. In this case, even when the time of making a 
car park and stop and putting a shift lever into "P" or "N" and a door 17 are opened 
and closed and people pass car back by chance, the image at the time of being in a 
condition without the obstruction after people go past can be adopted as a criteria 
image. 

[0109] O The image range which performs an image processing may not be the screen 
whole region. Improvement in processing speed is achieved by limiting the processing 
field to the need range beforehand. 



O The image-processing approach for detecting an obstruction is not limited to the 
approach of each of said operation gestalt. By comparing a criteria image with a 
comparison image, if it is the image-processing approach that the part of the 
difference is detectable, other well-known image-processing approaches are 
employable. 

[01 10] O The predetermined display which indicates by superposition (super imposing) 
is not limited to a rectangle display. For example, the painting-out graphic form of a 
predetermined color may be indicated by superposition at an obstruction. Moreover, it 
is good also considering the frame display surrounding an obstruction as 
configurations other than a rectangle. For example, a frame configuration may be 
adopted for the shape of a circle, an ellipse, and stellate, the shape of a polygon other 
than a rectangular head, etc. Moreover, it can also consider as the superposition 
display which emphasized the border line of an obstruction. What is necessary is just 
highlighting which looks at a screen and an obstruction and its location understand at 
a glance in short. In addition, a frame display should just surround some obstructions 
[ at least ]. 

[01 1 1] O It is not limited to the recognition approach of distinguishing a "quiescence 
body" and "those with a migration body." For example, the approach of distinguishing 
and recognizing three kinds, a "quiescence body", a "migration body", and a 
"quiescence body + migration body", and reporting for three kinds of voice and the 
rectangle display according to the recognition result to be also may be used. 
[0112] O A detection body identifies a quiescence body or a migration body by the 
image processing, about a quiescence body, a rectangle can be blinked on the screen 
where a quiescence body and a migration body are intermingled as an obstruction, and 
the method of presentation make a rectangle follow in whose footsteps can also be 
adopted about a migration body. What is necessary is to carry out the main coordinate 
comparison of the detection body of last time and this time, for example, to specify a 
thing with the combination whose main coordinate corresponds with a quiescence 
body as the discernment approach, and just to specify things other than a quiescence 
body with a migration body. 

[01 13] O It is not limited to the information approach adopting both voice warning and 
a superposition display. For example, you may be only voice warning. Moreover, you 
may be only a superposition display (super imposing). 

[0114] O An image display device is not limited to the monitor which projects the 
image of the car back which the camera photoed by the animation. For example, while 
displaying the ** type image of a car, you may be the image display device which a 
lamp blinks in the location of an obstruction. Also with this equipment, a screen is 
seen and existence of an obstruction and a location can be grasped at a glance. In 
short, if it can report to the location of an obstruction, in addition, it is [ that an image 
just reports the existence of an obstruction to an operator ] good. Also in the case of 



a static image [ a ** type image or ], if the display mode of a display and the lighting 
mode of lighting of a lamp which tell an obstruction are changed, the quiescence body 
on a course and the migration body which entered on the course can be distinguished 
and reported. 

[0115] O The approach of warning with a sound is not limited to voice. For example, 
the sound of a buzzer, a chime, etc. can also report existence of an obstruction. For 
example, a quiescence body and a migration body can be distinguished by the 
difference in the mode of a sound, and can also be reported. 

[0116] O In said 2nd operation gestalt, the approach of using only the thing in the 
range of fixed distance (cautions range) as an obstruction among the migration bodies 
of the outside field OA on the outside of the anticipation retreat course PA can be 
taken. For example, on a binary picture, it asks for the cautions range within the 
outside fixed distance of an anticipation retreat course by count in consideration of 
distance, and let only the migration body of the cautions within the limits be an 
obstruction. Moreover, the migration direction of a migration body can be detected 
and only the migration body approaching an anticipation retreat course can also be 
used as an obstruction. 

[0117] O An obstruction judging means is not limited to what is judged as compared 
with the threshold set up for every block like said each operation gestalt. For example, 
the approach of judging whether it being able to become an obstruction from the real 
size which calculated and calculated real size, taking distance into consideration from 
the magnitude (area) of the obstruction on a binary picture (white field) is employable. 
[0118] O The application car of retreat exchange equipment is not limited to an 
automatic car. It is also applicable to a car with a manual transmission. What is 
necessary is in the case of a car with a manual transmission, to prepare a shift 
position switch, and just to photo the criteria image ImageO, when a shift position is 
switched to a neutral "N", and when the door 1 7 of a drivers seat is opened and 
closed. 

[0119] O The anchoring location of a camera 2 can be changed suitably. For example, 
it can also arrange to in the car [ which can photo car back ]. Moreover, the 
attachment structure where the lens section of a camera was exposed at the car 
posterior part (for example, trunk section) is sufficient. Furthermore, it considers as 
the structure where wrap covering opens the lens of a camera at the time of 
photography, and with covering, it is [ a lens ] dirt-hard and it may be protected. 
[0120] O A shift control unit is not limited to a CIF lever. For example, you may be the 
shift change-over switch formed near the handle 19. 

O The function of an infrared camera is attached and it is made to perform retreat 
exchange of Nighttime. 

[0121] O It is not limited to the configuration using the monitor of a car-navigation 
system. The monitor only for retreat exchange equipment may be formed. In addition, 



a monitor may not be limited to LCD but may be CRT and a plasma display. Moreover, 
a fitting location is not limited near an instrument panel, either. Otherwise in the 
instrument-panel upper part, you may install in a legible location from an operator in 
car indoor back that what is necessary is just the location which does not become the 
hindrance of a forward-viewing field. 

[0122] O A car is not limited to a passenger car but can apply retreat exchange 
equipment to automobiles, such as a bus and a truck, widely. Moreover, you may apply 
to industrial vehicles, such as a fork lift truck. Of course, even if a car is not an engine 
vehicle, it is applicable besides engine vehicles, such as an electric vehicle. 
[0123] Technical thought other than the claim grasped from said each operation 
gestalt and each another example (invention) is indicated below with the effectiveness. 
(1) In claim 1, the stage to photo a criteria image is a time of the control unit which an 
operator operates immediately after a car moves forward and stops being operated by 
the method at the time of stopping and parking. In this case, it can be considered that 
there is no obstruction in the location along which it has passed now immediately after 
the car which has moved forward stops. Therefore, the image which can be regarded 
as there being no obstruction is acquirable as a criteria image. In addition, in said each 
operation gestalt, a control unit is a shift lever 16 and the method of the actuation at 
the time of stopping and parking is operated in a parking location "P" or a center valve 
position "N." 

[0124] (2) In claim 1, it is a time of the control unit operated in case an operator takes 
a car being operated by the method at the time of entrainment. In this case, since an 
operator does a back check once in case he gets on, he can acquire the image which 
can be regarded as there being no obstruction as a criteria image. In addition, in said 
each operation gestalt, a control unit is the door 1 7 of a driver's seat, and the method 
of the actuation at the time of stopping and parking is opening and closing a door 17. 
[01 25] (3) claim 1 - in either of the technical thought of 6, 9 and the above (1 ), and (2), 
said information means reports the purport by which the obstruction was detected 
using acoustic-sense information (sound information) and vision information. In this 
case, it is easy to avoid **** of the information information which hears, misses or 
overlooks information of an obstruction. 

[0126] (4) Said information means is equipped with said image display means and a 
voice information means in either claims 7, 8, and 9 and the technical thought of the 
above (3). In this case, since the purport of the existence of an obstruction is reported 
to an operator by voice and image display, by both the acoustic sense and vision, the 
contents of information can be known and overlooking of an obstruction can be 
reduced so much. 

[0127] (5) In either claims 8 and 9 and the technical thought of the above (4), said 
image display means makes a display control it in a display mode which is different in 
said predetermined display by the case where they are the case where this 



obstruction is a quiescence body, and a migration body while making the obstruction in 
the image projected on the screen of an image display device by the animation 
indicate the predetermined display by superposition. In this case, it is easy to judge at 
a glance whether an obstruction is a quiescence body or it is a migration body by the 
display mode from which a predetermined display differs. 

[0128] (6) In the technical thought of the above (5), said image display means blinks 
said predetermined display, when said obstruction is a quiescence body, and when it is 
a migration body, it carries out the display control which follows in footsteps and 
moves said predetermined display to this migration body. In this case, the property 
and trend of an obstruction can be grasped by one division from the display mode of a 
predetermined display. 

[0129] (7) In either of the technical thought of claims 8 and 9 and the above (5), and 
(6), said predetermined display is a frame display surrounding said some of 
obstructions [ at least ]. In this case, since it is a frame display, an obstruction does 
not hide so much, but it can recognize through a screen what that obstruction is. 
[0130] (8) in either of the technical thought of claims 8 and 9 and aforementioned (5) 
- (7), it is alike, it sets and said image display device is making the monitor of the 
car-navigation system carried in the car serve a double purpose. In this case, it is not 
necessary to equip the image display device only for retreat exchange. 
[0131] 

[Effect of the Invention] The criteria image beforehand acquired when it was in the 
condition which does not have an obstruction in car back, and which be been [ a 
condition / it ] rich and done according to claim 1 and invention according to claim 9, 
as explained in full detail above, If an obstruction is detected and an obstruction is 
detected by the image processing which compares the comparison image when being 
put into a shift control unit in a retreat location, since that will be reported to an 
operator, before retreating a car, a back obstruction can be discovered and an 
operator's back safety check can be supported. 

[0132] Since according to claim 2 and invention according to claim 9 the time of the 
door of a driver's seat being opened and closed after that was made into the 
photography stage of a criteria image when put into a shift control unit in a parking 
location or a center valve position or, the suitable criteria image which can be 
regarded as there being no obstruction can be acquired, and the rate of the leakage in 
detection of an obstruction or incorrect detection can be stopped low. 
[0133] Since according to claim 3 and invention according to claim 9 even quiescence 
body and migration body whereabouts is distinguished, an obstruction is recognized 
and a quiescence body and those with a migration body are distinguished and reported, 
as for an operator, an obstruction can recognize a quiescence body or a migration 
body from the contents of information. 

[0134] Since only the body of size with which the detection body on the image data 



photoed by the photography means distinguishes whether it is the size which can 
serve as an obstruction in consideration of distance, and can actually serve as an 
obstruction is detectable as an obstruction according to claim 4 and invention 
according to claim 9, only what can serve as an obstruction can be reported exactly. 
[0135] Since according to claim 5 and invention according to claim 9 an anticipation 
retreat course is searched for from the piece angle of a steering wheel and only the 
obstruction within an anticipation retreat course is detected, what can serve as an 
obstruction can be reported more exactly. 

[0136] Since the thing besides an anticipation retreat course is also detected as an 
obstruction about a migration body while detecting as an obstruction the quiescence 
body and migration body which exist in the anticipation retreat course searched for 
from the piece angle of a steering wheel according to claim 6 and invention according 
to claim 9, existence of a migration body with a possibility of invading in a retreat 
course can be reported to an operator. 

[0137] According to claim 7 and invention according to claim 9, with an image display 
means, since image display of the purport of the existence of an obstruction is carried 
out, an operator can grasp existence of an obstruction through vision. 
[0138] Since the superposition display of a predetermined display with the obstruction 
in the image of the car back which a photograph is taken with a photography means 
and projected by the animation on the screen of an image display device is made 
according to claim 8 and invention according to claim 9, an operator can avoid 
overlooking the obstruction in an image. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The flow chart of the retreat exchange processing in the 1 st operation 
gestalt. 

[Drawing 2] Similarly it is a flow chart. 

[Drawing 3] The block diagram showing the electric configuration of retreat exchange 
equipment. 

[Drawing 4] The ** type explanatory view of obstruction detection processing. 
[Drawing 5] The ** type side elevation carrying retreat exchange equipment of a car. 
[Drawing 6] The image mimetic diagram for explaining an image processing. 
[Drawing 7] The explanatory view for explaining obstruction recognition processing. 
[Drawing 8] It is an explanatory view explaining obstruction rectangle display 
processing, and (a) of (b) is [ only a quiescence body ] a case with a migration body. 
[Drawing 9] The screen Fig. explaining rectangle display processing. 



[Drawing 10] The screen Fig. explaining rectangle display processing in the 2nd 
operation gestalt. 

[Drawing 1 1] Similarly it is the flow chart of retreat exchange processing. 
[Description of Notations] 

1 — The automobile as a car, 2 — The camera as a photography means, 3 — While 
constituting an information means and an image display means, the LCD monitor as an 
image display device, 5 — Retreat exchange equipment, 6 — While constituting a 
criteria image acquisition means, an obstruction detection means, an information 
means, and an image display means, comparison image acquisition means, ECU for 
images as an obstruction recognition means, a superposition display means, an 
obstruction judging means, and an anticipation course calculation means, 7 — ECU for 
car navigation which constitutes an information means and an image display means, 8 

— The shift position switch which constitutes a criteria image acquisition means, 9 — 
The door switch, 10 which constitute a criteria image acquisition means — The speed 
sensor which constitutes a criteria image acquisition means, 1 1 — The steering piece 
angle sensor, 12 which constitute an obstruction detection means — The speech 
processing circuit which constitutes an information means, 13 — The loudspeaker, 16 
which constitute an information means — The shift lever as a shift control unit, 1 7 — 
A door, 18 — A steering wheel, 20 — A criteria image acquisition means, an 
obstruction detection means, While constituting an information means and an image 
display means, a comparison image acquisition means, an obstruction recognition 
means, CPU as a superposition display means, an obstruction judging means, and an 
anticipation course calculation means, 21 [ — A comparison image, S / — An 
obstruction, PA / — An anticipation retreat course, SS / — A quiescence body, MS / 

— A migration body, R / — Rectangle. ] — The image memory, 22 which constitute a 
criteria image acquisition means — Memory, ImageO — A criteria image, Imagen 
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j£i;T*y • ^7t S hTi^D S ^ffl*t§o F7MI 
S(D*> • *7tf«I09t)«Ci:fc:J:otH7 1 7 
©BMtffcttStt*. 

[0034] *a-b>ij- 1 o&. *a**ftffi-rsto 
t% wavteiscfcaaja^v s*a*-r* 0 xf7u 

^ -9-1 ltt. ix.a , xf7U>^^f-;i/ (/nVFW 1 
9 (i5^f) Hfft§Xf7'Jyy>'t7h (IS 

^-r) ^s^i^^u mum i s^n^efejs 

[0 0 3 5] *-tlffflECU7(t Mfy— S/a 
WJ»*Sl*fcftOtiO-e**o ^tTfflECU7(i* 
S^SW«r*rSo *HSB^T«, ^-tfffl E C U 7 

so f^um^n^o 
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[0036] mmm e c u 6 *&mmmm cut, 

CPUtl^o) 2 0, BflM^Er'J 2 lfccfctf^U (ffil 
X(fROM^ocfc^RAM) 2 2£{I*S 0 C P U 2 0 
**r'J 2 2lCHB1f;^nfc7 P n^^Ar--^tcS^^T® 

frrs 0 »tPH#ffi»#a«H«ffl e c u 6 (c 

PU20), 5/7b*^3VX-<7f 8, F7X^7 

^9. *a-fe>*i o, Bft^^ey 2 i fcctofliricsn 

So Sfc* tfc«iO«KS*attH«ffl E C U 6 (CPU 
2 0) , ^7h^>3^7f8, Jf^-by+M 

o, BfiM-ty 2 ncckDi^nSo £f c> /o 

Bm^StiiSfSffl E C U 6 (CPU20), Xf7'J> 

ifrntift-tw i na^w^n^c fit, Hfi&ffl 
ecu6 (cpu2o) »cj:»)KflF»rai¥a. » 
we#a* *««w^a* **tfM*«^#aft^«a 

£nSo *fc, ift¥attLCD^3, BifflEC 
U6 (CPU 2 0) . ^ttffflECU7, tf^fflffllsl 

ssi 2, xt?-# i 3iz<k^m^n, mcLCD^~ 
$3, h«jbecu6 (cpu2o) , x—tvmEc 

U 7 fc± 0Bffl««¥a*^«**tl*o 

[0037] ^ ^ y 2 2 ic tf»iB3£a»a*ff 5 20 
cfcDfcWU JM^»c»*fcB»teJ:5»*«c4: 
7 1 7*BBBI!L»EJ«k:«0iiA,««rfr6, SlWltf 

[0 0 3 8] **ffiJKftgT*&. 5/7 h^>3^ 
TRj »cft*H, ^^30S®3 a tC*ffif<0«75r«H« 

X) ^tl^o CPU 2 0(4, IttBLfc 

^777*KSo oSO. Bflfc-r-*lcJe«*M« 
^TS/"ca6<Dx-££r 1 7 A»-ro«#Rlfl63B: 5 -3 

[0039] afciBeflttra-ett. »«**^&bft^4: 

s»tt*«oTH3H-r*Bflwaa*-r*o *ur. 
k mmvifo&oi tcomm mm) $t*«t% ^ 
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[0040] «iB^an9»c«(t«w«ntttti 
^7hu^-i 6*/^-*>^ (amfiS) rpj 

B««rS*PB« Image 0kbTSffl*r So K7 1 

7 ^BflEH^n/£:B#<DB»*S*PB«lmageO k LTMSf 

IT, BiWLfclSfc, jBKMtOFTl 7#BIJHS*ifc 

4Li8fr6t?S8o 

[004 1 ] Effff LfeWra. *oa»oi»tt*Pitf 

0**lcif*Wllf^i:*4L#S. l£f#*<0 
»«©»frB»fcfi*fe»fc* ««v = 0) > 

->7H/^-i 6^ rpj tnj uz»fp?nrcWp 

<3D»7?B«*a*B«fc LTfUS J: 5 LTl/^c 
[0 0 4 2] S/i, a«J«OKT 1 7^BBBH«nfc«f 

§ fe 46 DS ^ T € k £ lc \Z-J&Mn<DW5*m&$ S 

*H»lmage0*M*rrs<O«:, fi(W*Lfc», «iB 

tffeS, ^7M//^16^ TPJ gfcfcfc TNJ tCjfff 
2 n fc k # <D»#B«*«*B« I mage 0 k & £ Mft 

Stifekt <D»#B«*:S*PB« I mage 0 k L TMiff*T 

[0 0 4 3] ^Lt, S^H«lmageO<DfflB (B#£iJ t 

0) v/7hb^-l 6£ TRj tcAtlSk (Bf^iJt 

1) , m^^HQA t («*tf3 3-66S'J») ffitc. 
JtRBttlmagen (n=l, 2, 3, *Wkm&? 
So ttttB«lraagen*lttaS-r*fttC, S^Hf^lma 
geO kltteB«*lmagen k«:S»«l9-rSB«ffl9* 

^<^sk (v=^o) , ^kmsm^m^Witt^o 
[0044] hi. B2«, aBi^afflao'/D^^ 

ffi^v SK:atJ#e»*i (v = 0) LfcCk^ 

i^^nsk, cpu2 0(aviwn§o 

[0 0 4 5] HI KSf7P- ^"fr— ht4, S^Bftlm 
age0^Ji^*rs/c46O^l"efeSo H2^t7n- 
^*^-h^, S/7bW<-l 6^ r r j icMftZftXfr 
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^^^2tCcfc^ JtRjBft I mage n OfflR^BB 
te£ft, ^-^3 0HE3 aA^^5 2^J8Kt"S*M 

?&%t>\ •P5^»#ffiUTfeaili : f«*-*3 0iiiB3 
3 a*C»*Ott»tfttLiasn«o ^~*3<DIiM3a 

vsp^trj tcAnen^^, cpu20^^y7 

[0 0 4 6] WT^ »iI£«fflffl©:/n^AK:o^ 

fy^l 0-Xfyy6 0STOJ!Htt, f£7?K»«35 
ft^l/^k^ft L^5ttJ»OB#OH«*»«PIB« Image 0 20 

[0 0 4 7] Xf'yyi Om S/^bsS^a^S P 

^aVSP^ rpj Sfcfi TNJ T'Sftfcf. Xt7 
y2 0tciit?o S/^haR^gVS Ptf rpj "^fe 

tnj ^tajtntf*o**^*»03B-r«ra*-r 

£o »«*»c»jBv^0 4:a:ofck**«:«, SRfflg*: 
[0 0 4 8] Xf7 7 P 2 0m ®^HiifflilmageO*tB 

age0«B*>c«ij 2 l o»f*E«B*»i:|Btrr*o 

[0 0 4 9] XT7^3 OTtt, 5HEJ*<OF7 1 7 #HJ 
F^n/c^«W§o olt), CPU2 0tt, F 

t««r«. FT 1 TtflBBHSnfcfcWWStifci:!? 
fcfc, Xf77 p 4 0\cm&, FT 1 7jWfflBfl;£ftft*Pofc 

tfrtixfyys otc}ic?o 

[0 0 5 0] XT^yTM 0TH2:, S^BHtlmageO^H 
^7 2^f,^n/c 1 tt0S¥SiftlmageO«Gfft;< 

^eu 2 i omss5«*«*ciBisurM*f'rSo 

[0 0 5 1 ] Xf77 P 5 om S/7h*^3>S P 
TRj T*fi*^5^*¥iJ((fr*o SP = ROfc*ttl» 

*««»jaia!7i/— ^y^\jatro sp = RT^tttix 

[0 0 5 2] Xf7^6 OTIt 5/ 7 h*^>3>S P 
*< TPj gfctt TNJ Tfe£^Sfr*«»rr£o ^>7h 

#^>3>sptf rpj s/ct± rNj -e&ftif, xf7 

:/3 0lCii^ S 3 0-S 6 0<OjaiS:ttDIto 0$ 50 
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>'7h*^>3>'SP^ TRj fc&£*>\ rpj, 

tnj cm t ft 1 1 <Dmm\cw*w*\* 

#^gysptf rpj , tnj , rRj w^oaK^s/ 

[0 0 5 3] ^tC. Xf7^5 0ltCi3^r^y htfv^ 
3>SP^ Trj T*ftSi:¥iJ»fSnrci:tJ£:*fif^ns 
»*»«»«Hl;l/— * yo)7 p n^7A(co^Ti2^^ 

^6*0. Xf7y7 0-Xf77 , l 1 0#»«tt#fcH 
flQH* Xf77l 2 0^H««BMffiI, Xr77 p 13 
0, 1 4 0^ig»a Xf77l 5 0*W1I 

[0 0 5 4] Xf77 ! 7 0^X77^1 1 0*^45» 

ft. m^WfiBA ttttc»**fT*n*o c©i»*»*ua 

M&attHfr B » Stt^ttffi S ft * KB Xf7^ 

t**o ^oBaBBaKjetT^ox-r^n 30, 1 
4 o©v^-rft^*aiRL. im^tcisu^^g&^r 

fT9o •?* LT> Xr77 P l 5 OT&t-* 3«3 a 
IcWLaSftT^SBJMS OftSfft) *<0»S^Jc^ftS: 

[0 0 5 5]Xf7^170, 1 8 OB, Mff^l'-^y 

fc*, S 1 7 OTii^ilv*^ (v = 0) 

JfirfflKU S 1 8 0W'>7h^>3>S Ptf rRj 

(sp = r) TfcsfrefrswK-rso 

[0056] ccf, wswwaffla^-^yoiftiaa 

T*&£, KSfttttUfiOdl (S 7 0~S 110), 

?mmm as 1 2 0) . ^reara (130, 14 
0) , ^xzfmmmmfrMmi mmmmm^Mm) 

(s 1 5 0) ico^rparr &o 

[0057] (.mwvstk&mm) s-r, 
tcoi^TSMrr^o $txT7 7 , 7om j±®BH*im 

agen«:JMB*r*o C P U 2 0(^^7 2^6KaS«ft 
fc 1 ft ( 1 7U-A) cDjrtl5®^lmagenOf : -^^rA 

[0 0 5 8] Xf7^8 0m 2ft(0il]f^lniage0, I 
magenJ&Jrkli-rSM^JflJiB^-rSo CPU2 0t±Hf*^ 
*rU2 1 ^6S*PBfiR Image O^tBU, 2 ftcOiiiigilma 
geO, lnagen«Wltfe^»cj:«HttAa«r-r«. « 
x.^\ Image n t Image 0 t<D%co$&*ii\& (I lmagen-1 
mageO I) £r£D, ^OMiMHRfcKBJfflfflSart-o C 
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T~mmi%*n2>o ~{IHfl^--£T*fi. ImageOklma 

gen tTm%-or^z>^fttf&mw (f*-* r 1 J ) t 

[0059] xf779om mmmm?%tz<D 
^m&mmm ^mmmmm pa«^ 0 x^r>; 
y^n^-fey+fi i frb<Dimme s^m^fr, % 

tfitss^fflo^ 0 ti-watt, -«iB«±ojaifi*#ia 

OSaif*fiE9o 0 6te, z:tt]B«linage**S«k:* 

Lftt»©T, fsaaiBPAtts tma:*^***- 
T^a66n^>o H6 (a) ic^?£5ic, mm<otz<D 

WnftQ (=0) "Ptt, ^*«JU» PA 

6 (b) tC^cfc^tC, A>F;H 9&V]rDrct%<Dty 20 

t\ne (e>os/:ii:0<o) -ea, ^RBfiBKM&p a 

fc. ^fifcilitl&P AOfitt*i»uStf*l/^o ft ft* 
0 6 (a) tftt, «ffitMaS^^<I6TvTbT 

[0060] xr7^i oom «ffi»{*frS*>fX 

tf>f X#W«1M X*jfi** t>00*Wf*l: LTi 
db*T^)o 0 6tc*cr£5^ S^fiMfgilmagelcfttf 

teH5£SftfcH«B*rffll\ *:/d y * B Stereo ;7n «y 

^BrtteHK-efeflsfe-rsaflBW (06 (a) t*«h 

ft) OffiSHIIi:H«[i:0*/h]t«a*'r*o aflJWtoffiSI 

KHWjcoi/^rtt, aw^a *a®«<o*^ffi 

nrfli"Cfe*o Hefc^-r^aaaaiBP aokh^o^ 
[0061] xf-^yi 1 w»w^«tBsnfc 

#0 &ft, WS^B««igu:tt. SuIhIO^J t -1 £4-0 50 
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f-?^^«ft^ SlXf 7^1 1 OTPpfft 

tsoti, nmsws (n^2) <Diam^^Mcm& 

[0 0 6 2] (MflFWeWOa) ^tCX-r^yi 2 0£> 

[0 0 6 3] $-T/^y^r «ff^JfflkSuHIffl0 2o 
W777) mial4:^|5ife:i3»si»a»*ttj»o 

(e«a«) ®**tti»«\ *nfnNt-i, Ntk-r^o s 

fc. *BMait-1. t U:fe*J*#l»lF» ca««) 

*n^n Ck.t-1 (fiU k= 1, 2, Nt 
-1) , Ck,t (fit. k=l. 2, Nt) £?% 0 C 

«ot, WTO®, ©Offlffl***!? do 
[0 0 6 4]® tftaSSJtK-rSo Nt-1*Ntft6tf 

r»»«#A^abDj ^-r-So «**fH7 (a) tc^-rj: 

ate, «?}»J t-io«a»NM^ r 1 j T% B#^Jt^ 

t fcw*Jt-iT*m»o«iw«<*ofc«dH:i&"r 

[0 0 6 5]® Nt-1 = Nt<Ok#«, SWfgiJ t-1, t 

i*«*jtiW"*o mzismmt-iotpfommck. t-i 

Ck,t) h4o<h, (C1,t-1, C1,t) , (CI, t-K C 
2,t) . (C1,t-1, CNt,t) . (C2,t-1, C1, 

t) , (C2,t-1. C2,t) , (C2,t-1, CNt,t) , 

(CNt-1,t-*U C1 f t) , (CNt-1,t-1, C2,t) , 
(CNt-1, t-1. CN,t) (D& o iC^TCDm^lC-D 

[0 0 6 6] 07 (b) tc^-ri:dtc, ±T©«M**<» 

k-eaft*fRii:4<o^ — sbrn e*«a»Nt (= 

Nt-1) tC^b<^^ 0 cfcoT, Ne = Nt (CO^JT^ 

n e = n t = 2 ) ^iL-rntf, r»±wfto*Lj tm 
m-rz>o ttc 07 (c) ictftzoic, i&mvQWhm 

"C*ffc-r*Cfcfr6, -a»Ne*W«HJ«NtJ:0 
/ >^:<^;^o i:ot, Ne^Nt (CO^IJTti 1 = N e 
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s c «tffi*tt*w*» (asB«) s 
[oo67] ccoxf'v/i 20 offla-eowsia* 

[0068] Xf7^1 30 T?*i. gfrit^ffl*)^* 
**ff-5o CPU2 0tt^^U2 2*>6»±«Jf*fflO« 

[0 0 6 9] Xf-yyi 4 0Ttt, feWiWawmo^w 

^tt'rtVo CPU2 0tt>«^U2 2A^»«F«lf*fflCDfi ; 
^f-^^ffiU SWQSIhIBI 2lc)MfrfSo * 

[0070] ^mmmm^HBM) ^xf-^i 50 

*0^*O»»**3lfll«Kr*o dOlB, IMF*** 

[0071] wt, je«««**aa*B8. B9ic«e 

otW^o C P U 2 0«50<0^y7r(cfE««n 

[0 0 7 2] B 8 ttft^y 7 r t«#pf(6ftft7 U-L 
So HBfcfcttsefrSJKteBtSJt. t-1. t-4cD& 

L^r—ztfAtiznzm (a t ^usia-rss) fcs-r 

[007 3] M777lcg^n5f-^i:lT, 

saa^ e> 2 oco/ ^ ^ - ^ d i sp, st i 1 1 wtrtn * 6 n 
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sp£r r i j , ^#?g£Lfc£^;*-*disp£: l~oj 
cOh^tc/^^-^still^r r l j , r^ift 

«mm&dj okfHc^^-^stMi* roj kts 0 

jgiJt-4fc*SST* (5 • A t«) ^©g^»3B!Sn 

[0074] • iiiffloz:ajsoa**a^« 

(O^'y 7rtc^^n/c/^^^ — ^disp= \ <Dh%(Dfr 
UtT^n^ fi*<D/^y yT<D/^* — #still<Ofii<Dg 

OV>T08 (a) , (b) ^ffi^tPW^c 
[0 0 7 5]® f*lh%#0#tf>*& ( (08 (a) ) 

20 *disp= i-e*tttf, je^-^Srm^-rskfct^^ 

— ^disp= 0 kTSo :&fc:*<D^SiJt-4T*0/^* 
-*still*:JISo T|t±%f*cD^J «:;5Vrstill= 1 ft 
6tf. — o«rbc^»lt-3O/^'y7rk:»0. disp= l 

a e tf^co-r- # *jb*-t skk^tcdisp-ok-r 

So ^co^Jt-3T^/^^^— ^still = 1 ft6«S6k: 

-To cnic^^m±^w<Dm^m^Lri^m^- 
So cfcoT, #±w#©)e»**«5iaK: i iHtisssn 

JO S/i#u 0 9 (a) tC^-T<fc3(C r»±*#o*J CO 

[0 0 7 6]® ( (08 (b) ) 

S-f^S (S#S'Jt-4) o^»y7rk:«MW«nfc^^^- 
^disp= 1 V»tiH. m&T-Z&ffittZtt&lc* 
^p<-^disp=0 kTSo mc*t<Df%mt-4T*<D/^* 
-^still^mSo mmVdfa&Ktl *jR-4-still = 0-p 
feSk^ti, |ffbtv^y^r^SCk^^< > as 

^ cvtmvrztb. &mm*(DfcB&, m^m^^coo^ 

*»iSft8o *Ott«, 0 9 (b) tc^T£5tc 
ffi»R*^ft*f*MSK:iiiabT»ft^r*o t)s ifi 

je*^a«a^ sns "t*j^«tt L/^i/^o fe ^ s a,. 

So 

[0 0 7 7] *k:aii3Ea«s«5<o^fflfcoi^TKW , r 

50 So iSWJhlTS/7hW^-l 6^ TNJ ^^c 
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rpj tcAnensk, a ^ 2 ic £ o th&e>s*ph 

«lmageO#JI»<*nSo *-<Df&> 5HB*OK7 1 7tf 
WJBHSnSftfc* PIS Image OA^Sf^n^o cti 

Slllfeifiu^JWOililflft^SViffiflRlmageO k ITIl^ 
*U 2 1 tcfBttSftSo 

[0 0 7 8] CCT\ Bff*0|««**C*ffii*aai/j* 
»«$Wllc, ate#***W*6ftDS«di:, 

->7hU^-l 6«r Tpj Sfctt TNJ icAttfc f?£) /0 
W«#S*PH« I mage 0 t S *U »B#tf 6 ft D 
*»^tt* ia^OF7l 7^BBBB*tifc4:#Oiffi«^ 
SVH«lmageOfcStl*o *W«:efMt 
S«&fefc*tt*O»*tt^31^T#fciima:<0T% fit* 

ja«*^a»Hilfc1inage0i:LT»6n*o ccST^fi 

[0079] ^tca^^wsaii-rsfcfttc^^ F 

U^-l 6£ TRj tcAtiS^ *^2tc<£oT«!i5 
?nft Wft)3<0R»tf 3 ©IS 3 atCf$Lffi£ 

n^ 0 o^d, t-*30iii3atf*-tey-^3 

So 

[0 0 8 0] -rftto-S/Bf^MA ttttctbttB^lmag 
en (n= 1 , 2, •••) aWHBStU ^OfitCfi^HflH 
mageO^Jt«H«lmagen (n=l, 2, ••) h^rWS 

(Dtyftft 9 ^ & S^S»iiJlB8 P A 0«HrtT*»S 

[0 0 8 1 ] r|»jJ:»<*:0*J <D»&tt, 1 3 40 

^ ^tc. H®3 aOtt»*tcl»«**BCf)©B*^«a 
f^tl§ (0 9 (a) «r#88) 0 -77, mmvt}fo& 
OJ Xt?-# 1 3ft*6«B*T TiigStcPiS^ 

•M^KiBBIUTIJtt-r* (H9 (b) *#KD . 
[0 0 8 2] CCDfctb, 5HE«#*W*«iiS**fc«> 
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ictoi»f*«ia , rckft<5!iw4. 

[0 0 8 3] Sffi3 a*RT«*OSSe^BBB*fT 

oTVSBfcSfctt, Hffi3a<Dtt«* 

<£>T\ ft^©ttK**©»fi*T*fflaL»^ 
[0 0 8 4] COJ:dtcffie#*^H*Eff*S-yrT^ 
6ftOT^*^*&&fc:M:. ^7hl/^-l 6^ TPJ $ 
fctt TNJ tcAnfch^A^, $fcWE#tf*W*ft5 
fc#&fc:tt, FT 1 7^BBBBSnfch$*>6. *pW» 

[0 0 8 5] *Pi*t«iIU*&«>S4: (*5Sv^=0) . f£ 
m^n^o ZcDfctb, 9tSS»iI*fcHffi3 a<D8fe»*51 

x tfisxn© ^ # k *ss©asf*B* ^ tc a r § >l« 

'>7hl/^l 6^ Trj A^6fBOffi« WJx. 

rpj , fnj si) tc^^^^^n^i:, ^er:^3^ 
uDiiB3 att*W«*0^fr6^0iB«k:«IDlR*6n 

trj ^6fBfl!)ffiwc«?)»*6nfc«^fe. «iisa 

[0 0 8 6] W±l¥aLfeJ:3»Caiai««»te*ntf. 

(1) »PS*ail««*fc«)»C$/7 hU^- 1 6^: 
TRJ jcJUffbfclRU:, ffllE#A^*Pi*eff***T3!p 
SftOT^^ftl/^lf'&fctt. ^7h^-l 6£t Tpj S 

ft** tnj tcAn/-ch#*^ *fca«#*^*is*fto 

rc«^»ctt. ft 1 7tfmmzrLtctzfr%. 

$ tts-r $ To*w«^rott»iKfb*if«loi!fc: «fc o r ^ 

^e— ^tctt^ 3 cohm 3 a tcB*bm^nro^ 
-X) tfasnsot, ws^^-raa-rck^ft 
cfc o T«je ka* k 6 we#«***3«« 
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Site, ^*3<DH®3 afr6S*«LTt, g^Sfg 

So 

[0087] (2) i«S6«ri sc^jn^e^s^w©^ 
mens p a ^*i6. ^s^jiiiBg p a okb/sw* 

l***©*lti#«MBH4:'*-*©T?, ^-OttQttmft 0 £ 
£ LJfe«iB3^±OI»»WO»«WE«lc«5rr * C t 

fSJtT'#3 0 10 

[0 0 8 8] (3) JvWVatf r&±W)fo(Dfri mm 
b^\ 

[oo8 9] (4) x-/<-r>'#-x*i»gifc*Htrie 

[0 0 9 0] (5) X— /Wit?— X;tfftSHJ*ffl€?JE 
i: ^ 3 #«^ft©T\ ^ff$tc <fc o TIBMrfetfS <fc A, if 

So 

T^fclT'^So 

[0091] (7) m^mm^hibrcmi,^-^ 3(o 

T% ^ilcJncte^Tk^:^ 3©Hffi3 a?:i§CiT 

ffijB^asn* 3©HBi3 a*lSi: 

[0092] (8) *— rw— ->3 yi'XfAOt- 
*3*»iIS««H5K:?iJffibT<^Sa*, «#3 0B 40 

&l/\> $fc, *-tey—>3 >->^f AO*-? 3 * 

mm-rz>ctfr<b. mm*-* *mm? 

[0093] ( 9 ) avBttioage o zm&tzmmt 
lt, ^H/m-i 6^ rpj tnj (cxne 
nfcWi:. ^©f&ic;i$E/£© FT l 7* ! ra?nft«fk 
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[0 0 9 4] (1 0) S^iIHgUmageO^Mte/rft© FT 
1 7^W]-r5filcMfr-T«.cOT\ ^MfOjMi/^iftcj: 

T#fe»e#*«*PS*»ii««**-&* t **o C©ot? 

FT 1 7«rggp s flb/c:^f(c»tpB^lniageO^MKf^nS 
©T\ !3*^#lRjbWm©S*PWfi Image 0 4: 

ttKiMMinagen fcWtttrSBJMaSfc**©-?, S 

[0 0 9 5] (ll) fflfii7 r -£*j§5fi<E>)iW;:<fc5lg 
tO^n <y ? B fc#9J U £Xn -y * B«©S8ffl«rfflt/^ 

xitmw*©? %nm%t^ om s+m'x© *>©#!*& 

tf^ X**»S% ft 9 * - Xfciffl * 4 1 ® 

[0096] <^2<DHffl^«>^tc -mzoymmm 
?:0io, eh i ^-fflt^Ti^B^-r^o cnmmnmM. 

-»*«MUfcflf!"e»*. futESfi i ^ 

«ttii3tB8PA©«H^ Wffi«0A) OWttc^T 

^SfcilJtKP A©iEH^-rfeoTt^®l#H*{COV^T 
«P$«#li:bT^tb-r5<fc5^bT(/^o C*U±, JSK 

ig»)*lRl4:S*MBIK?Eft^T?#S<, £©<£ 5 ftJEftfc 

[0097] in i i ic7n-?£?ic, ^mmmmommm 

maSBMtl^f-Mt. Xf777 0, 8 0t. Xx-yX 

1 5 o~ i 7 o(±, mmm 1 (Dmmnmtmm^mfm 

[0 0 9 8] Xx-yX2 0 0 ©SaffiMEllti;, ~ fiffif^lm 
age©^ieffllc*5t/>rtft)n?>o "Tftt)^, "ffiMSslnia 
geO^«H*iaiffoaivicjS: bT*Sf©ya y * B tcE 
»b, *Xa-y^»K:a5Be«nfcBBffi*ffli/\ Xn>y^ 

m„ Miem i (ommmrn (s 1 o o) a^^jIji 

SSP A^5r»ti:Lt^/c(0lc»b iSft^lSH^ 
[0099] Xf77210T'lt Xf'y/TO, 8 

o, 2 o o©*aafc:<feoT»****tttt«nfej!ps*»* 

tsn> ^^jiitSSP A^iBHntcoVTtPiS^l© 
^dSA'iftSnSo »*%*^mStintfX-r>yX2 1 0 
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[0 100] 7x7^2 2 0T»tt, 
<y:/2 6 0&cjIfr o 

[0 10 1] Xf7^2 3 OT'tt, (^iS 
JC^ftLtt^tl'&ttX-ryy 1 6 0lc3itf o n 

?nft^ 0 »±«t**^a«iiJiBSPArt*cs«E 

-r^iI^ti^OXT'7 7 P 2 5 otc}i^. itK±fc»ap|» 
[0102] — 7^ 777^2 6 OTtt, &W)V!)faCDm 20 

[0103] ^wsw^a^ffls (^iiss» 

ft, ^HJcOA^Sfi^tcHg-r^T 1 -^ (JBJBx- 

Ote^JgailJlKP A*ffifflL (Xf7y2 3 0, 2 7 
0) , Xf77 P 2 8 0m ^ffi«iiii»PA^*^ 

[0104] fit, xf7^i s om je»«*ffl 
3#hWb» i (ommmmt mmcmfttznzo r»it» 

iBattp Artfc#ffir*»w»c*n«Htrje»*^«« 
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[0 10 5] ffl*.tfB 1 Otc^f cfc^tc, nflWOAIc 
k, *j=.*3<DH8fl3 atc8feLaisnfeB*»±*cttcaD 
5i3lc^n5o C<D/cft, i«E#ttiBS3aOW 

[0 10 6] K±W3*LfcJ:3k:**SlBg«teJ:ntf. 
iutBfg 1 OlISSJBffi-ea^fc ( 1 ) - ( 1 1 ) 
rattHcfi&ftaflk ttTO»*#i6ti*. 

(12) aMBfijc«Atssnofe48i»#*i 

«s# fc: i: iB««c J: ^ T«»-r S c i: tf-e * S o 
/eft. *H*»ilS*«IBte»ii»KU:«X-rs»nA' 

[0107] xarau:. ±B*cB«anfWT 
tnj tcxn/cB#^^, rpj jcxnfcWpo^ftSffl-r 

*CfcfeT#*o cn^>(Dm^ Mfc&CDFTl 7<Dffl 
Mte«toTtta*]a«lmageO}b<H*r*n*v^l»»«!i 

^omtcFTl 7^liBEHSnfc«p, rpj «r«t 

»»*fT -5 c k fe T# §0 (W ^ «f Htt«<0 -tr k b T , 
[0 1 0 8] O SVBtt^rilK-rSktf^ttftttOBi 

[0 1 09] O ia«jaa*f5 , 5IB«KHttffiiffi±«T 
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o &itv><oM*9B>mfimt* mz&m 

[o i i o] o n&&m (x-^vo^-x) ?%m 
mmmt. ^mm^icmm^ti^\ mm. mmmc 
fft7Z&<omomL®&*mam*\sXi>&\,\ m 
mvB*mts&m7jk* i fe&iw<DBVi£Lxt>£\,\ mx. 

is, »»WO'>ft<i:fe-aB*Htft,Oi»* 
[o i i i] o r^ih^ttco^j ^ r&wm#3b*)s 

<0 3jIt>£EgiJLTlgI«U ^C0ig^i$g*t[5i;rc3ffl 
[ 0 1 1 2 ] O *tB«j(*:*^±«jf**^!!l1ft«:^*Hi 

«f!&Hfc£oT»JU P$*^ji: LXffi±yafo£&m<&a 
B*gmzi±. ®mwmz-o^x& ! m.B*&ffi-£it2>m 
man® t^mnfamawcD^fommvcwt u <*>^ffi 

[0 l l 3] O «*a73ffifi^HSi:«Sa^tOS 
[0 1 l 4] O MtSi^Btt, *^7*<«|gLfe* 

tc 7 > zftffiM-r % wm^mm. x& otti^ co 
mzmtnxztiii j; < , -c«»i-e*ftW: 

tiff, JtlS±0»±«!it*:i:Ji8S±»cAoT#fcSHM*i(* 
[0 1 1 5] O etcj; o T5f S 73 i£ BfSfc PS 5t 

sna^o $J*tf7if-^WA&£<og-K:<fc'7P«* 
m<DW-&*m%i-Tzctt>xzzo mm. »±m»t 

[oi 1 6] o m&£z<n&ffiBWAzis^x. nmw 
o a <D®mv>ite(D o *>^wtemm& p a cona^— ^sg 50 
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fcfHSKJ: *©&«t!IIlrt©&l!;W*©#*:P# 

[01 1 7] o bs«bws#s{±» nm&mmftmco 

OKIB£Sft4^. mtf, -fililifflLtOBSUB (631 

<d*#2 ^e»jijfi*#^»i:AnTii+j--rx 

&fitS U It® LfcHMM Xfr 6 P$«&l fc ft t) » S frS 
[0 1 1 8] O »ii3?»»Hoaffl»Ktt*-hv^ 

(c»ipil{t Image 0 ^JfiJ-T 5 <fc 3 Ic-f *U£ .fc(,\> 
[0 1 1 9] O *^7 2©IXMW«mttafi:fcaST? 

Sft, (CTAtf h^V^SP) let)* 

^(D\yyx^mm^^fzmnmmxh^i\ 

*^-fc iot U^X^nii < SlLTtJ:v\ 
[0 l 2 0] O ->7 h^gPti'>7lxM-{;:pg^$n 

[oi2i]o 7- try— ^3 y^xfAot-? 

Snf. CRT J ?7'7X7fVX7 , Wt'$oTfeJ: 

[o 1 2 2] o *M«mffl*fcpg^?n-r, Ax^h 
? -y * * if o i »* c j£ < fiaists*B*asffl t * * „ 

7* — i"J7 b^<DMM&ffilcMmisX't>£\ / \ 

[0123] miies^)5smtRtJ : &B'jf?ij^e>ffis^n?» 
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[0 12 4] (2) 1 K*S^T, M<E#*^MJC 

Bfi&i:b-CIDtf#T*#S 0 wim&MM&micte^ io 

t, af^»f±aeflS<o ht 1 mwrnmcomt 

oft^ti, K7i7%Wtl.i:i:ffe5 0 
[0 12 5] (3)SI*iHi~6, 9 St/HuaB CD. 
(2) ©S«SI<o^fn*H;fc^T, i!WB«35l#a 

mwtic£iom%}?z> 0 c corns, mmn<omm^^ 

[0126] ( 4 ) W^^S 7,8,9 SUfijfe ( 3 ) O 

m^mmv%mmm9itmmz.z>o c corns. % 20 

P t flfitifea* t K «fc o T iGtlc BfiO#S©li!) < I 
5CtWf, *tt;Ettl»*&©lli8b*«5-f 

[0127] (5) m&ms, QRxjmm (4) ogi 
«^«aoiBffi icmwxwi b tu s ns sms* ©»sia»c 
i*T*fe 5 Jf t &m®»T°&zi£& t xm em s&s^* 

nmmwx & s a -efijuf b @ t/^ 
[0128] c 6 ) me ( 5 ) co&wmmmic fcv >r, 

k ttt3fSBfsa^«r^Ma -a-, &WMWxtr>z>msK it 

[0 12 9] (7)11*318, 9RtfHijfe (5) , 

(6) <D&wmgM<D^-?tifricis^x. mmmfem.^ 40 

S fr^BffiSril b TKKT $ 5 „ 
[0 130] (8)11*^8, 9Rtfltuf2 (5) ~ 

(7) <DStl5WS^<DO''-rn*HC*5(/>T, Kfc^T, flu 

y^x^Ao^r-^^itfflbT^So coe, mmg. 
mmm commmmmwzmm-rz em*/** v ^ 

[0131] 

[$893©as*3 «±i¥ a> b/c ct b ic$mm 1 ro*«*s 50 
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4 a ftfS * «JBO«p tc ^AIXS b fc S^BIf „ ->7h 

■&^mim^<omm^^Lxmmmcom^^mm 

[0 13 2] 2 RtfW«« 9 EEttO»WK«fcn 

to^it'tcomcwM.mco vr-ffmm^txrcm 
mmmm<vm&mmtLrccox\ m'sntum^t^tt b 

ttfflOffl^Sffi <»x5Ct tfT $ So 
[0 13 3] l»*«3&t>"l»^9tie«©5l^fc«J;tl 

a. mmM*»±%tecoz>.fr®W)V>>w& <o ^ *t?*ksu 

LTB*b, $&imW-<D3*k.®WlWW%>K> t*E.mLX 
W3UT SOT, SSfB#t3:ffiJq ftSfr 6 BS»^»±«lf* 
*^ft«Bft:*^*B»T?€r So 
[0134] 4 11*31 9 K|2«<0«WK: <fctl 

IS b T ¥ iJ9J b . f c M«« t: 4 0 m S ^ -Y Xo**0 

[0 13 5] »*JB5&O t »*3B9»cSEttO«Mt«J:n 

O^ J; 0 WfiStc^BJPT'f? So 

[0 1 3 6] Sf^6S.mif^9{cKil©^{c«fcn 

S#ih%f**5J;y r ^®)W*%Pi^i: bx^tb-rs t i 
s ®mmwcote&*m%m\z.m.'m? acw-ps*. 

[0 13 7] W*^7SD r SS*^9fctatt<D«W(c«ttl 
«\ mi^Tr^mc £. D , P*«WO#ffiOMA^BfS^ 
?ft«OT. iieS^^^iffibT^StlO^-ffi^ffia 

[0 13 8] R*^8&O r S**9lCtS«©5IKH:«tn 

«, M&^mcz om^tEt\xmimmmmcomm±ic 
mmx9&L&ztizmmm?jcom&tp<Dmmmcffifcm 

[HlfficoB^^SiW] 

[0 1] ^1 0^fiS«fl8K*Jtt-5ail3£a«ra07n- 

[02] |p]b< 7D-ft- ho 

[0 3] SI$Sifi©S^iffi«:^t7n 

[0 4 ] n ^^tBsaiio*i^ittB^0o 

[0 5 ] m^mmm^mm. Lrcmmcom^mmm. 
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cm 6] mmmm^mm-t^rztbcommm^mo 

[0 7] »S»K*ftlH*WWf *fc*©SiWH. 
[0 8] »»«j^JBa^«ia*SiW-r*SiWH-efe»). 



2(5 



(a) niftitwiitcDfr. (b) \mwmw^n^x 

[0 9] jejg&jSft!S*Siiil3-f SHffiBI. 

[gii o] m2<Dmmmic&if%fcBm7jkmmttmw 
[011] iii;<ttii3£a«ia©7n-^-fr-h 0 

[^^CO|«B^] 

a, *««se«#&. asa*^®. 



aat«««w¥a*«*r**-^ Kffl ecu. 8 

O-fiiplHMkfl^gt^MiA-rsVn-kv^. l i-m 

i7- ft, i 8-*i, 2 o -&mmm 

Km®.? 3 kit fcJ£«H«Btf#^S, IMHMBtt¥ 

2 1 -s4iBfias«¥R««bs-r« 

^^'J. I mage 0- -g^MIU Image 
MM. PA-^«»iiJHS, SS 



K-tLTcDC PU, 
SHS^^U, 2 2- 
n-tfc«B«, S- 

-»±vm. MS- 
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(15) 
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(a) 



(b) 



(c) 
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(17) 
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[09] 



1 1] 



(a) 



(b) 



OA / ^ QA 



4 / 



R 

^SS 



\ 



PA \ 



oa ; 

/■ 
/ 



y OA 



MS \ 



-R ™ 



PA \ 



-^3 



Ji&itWl magen -S70 
HMua J-^sao 



S260 



S270 



,S280 




(51) Int. CI. 7 »BiJIB# F I r-TO-K (##) 

B 6 0 R 21/00 6 2 6 G 

6 2 8 D 

F * — A(##) 5C054 AA01 CA04 CB04 CC05 CE02 
CF02 CG03 CG07 CHOI DA01 
EA01 FA01 FC12 FE01 FE28 
FF02 HA30 
5H180 AA01 CC04 FF25 FF32 LL02 
LL07 LL08 
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